epicITAPPLIED AI ACADEMY
Programs / AI Evaluation & Quality EngineerIntermediate PATHWAY

Make AI Measurable

QA engineers and professionals responsible for AI reliability. Learn to build systems with hands-on projects and applied engineering.

PROGRAM OVERVIEW

AI Evaluation & Quality Engineer

Make AI Measurable. Develop practical competencies through focused labs, project work and a final capstone.

Who this program is for

QA engineers and professionals responsible for AI reliability.

Career alignment

AI Evaluation Engineer, AI Quality Engineer. Role alignment describes relevant skills and does not guarantee employment.

YOUR LEARNING BLUEPRINT

From understanding
to implementation.

01Evaluation Design+

Skills and technologies you’ll develop:

AI TestingDataset ConstructionGolden Datasets

Hands-on lab: apply these concepts, test the results and document engineering decisions.

02Judging & Review+

Skills and technologies you’ll develop:

LLM-as-JudgeHuman EvaluationHallucination Measurement

Hands-on lab: apply these concepts, test the results and document engineering decisions.

03System Evaluation+

Skills and technologies you’ll develop:

Retrieval EvaluationAgent Trajectory EvaluationRegression Testing

Hands-on lab: apply these concepts, test the results and document engineering decisions.

04Adversarial & Performance Testing+

Skills and technologies you’ll develop:

Red TeamingPerformance BenchmarkingCost TestingLatency Testing

Hands-on lab: apply these concepts, test the results and document engineering decisions.

05Operations+

Skills and technologies you’ll develop:

Production Monitoring

Hands-on lab: apply these concepts, test the results and document engineering decisions.

Show what you can build.

PROJECT 1

Golden dataset

Build a working system with defined requirements, evaluation and documented limitations.

PROJECT 2

Agent trajectory scorecard

Build a working system with defined requirements, evaluation and documented limitations.

PROJECT 3

Regression evaluation suite

Build a working system with defined requirements, evaluation and documented limitations.

FINAL CAPSTONE

Demonstrate practical competency.

Create a repeatable evaluation system covering accuracy, reliability, latency, cost, safety and task completion.

ACCURACY · Connect the right information.

Before you begin.

Prerequisites

AI fundamentals and basic Python.

Professional credential

AI Evaluation Engineer Professional Certificate. Completion requires published coursework, assessments, projects and capstone requirements. Final passing scores, exam attempts and grading policies will be confirmed for your cohort before enrollment. This is an Epic IT certificate, not a university degree or third-party accredited qualification.

Career pathway

Build on this program with a related engineering pathway or industry specialization.

Questions, answered.

How long is this program?

Schedule and duration to be confirmed.

What is the delivery format?

Online, live and in-person options subject to cohort availability.

What is tuition?

Tuition information coming soon. Pricing, payment plans, start dates and enrollment deadlines will be confirmed before purchase.

What technology do I need?

A reliable computer, internet access and the ability to run development tools. Cloud/API requirements and additional costs will be disclosed in the cohort syllabus.

Is employment guaranteed?

No. Programs develop competencies and portfolio evidence; employment depends on individual preparation and market conditions.

Keep building.

Apply Now