Skip to main content
FREE60 MINUTESLIVE DEMOLINKEDIN CERTIFICATE

How to Test AI: Learn to Become One of the Most In-Demand Software Testing Professionals in Tech

If your team asked you to test an AI chatbot tomorrow, would you know where to start?

In this free 60-minute session, Engenious University and Arato will take you from “How do we test AI?” to understanding a clear step-by-step method you’ll see in action through a live demo. Leave with a certificate of attendance to share on LinkedIn and a roadmap to start building AI testing skills on the QA experience you already have.

FREE LIVE SESSION · HOSTED BY ENGENIOUS UNIVERSITY

Thu, Nov 19 · 10 AM PST1 PM EST7 PM CET · Live on Zoom · 60 minutes

How to Test AI: Learn to Become One of the Most In-Demand Software Testing Professionals in Tech
AI agent testing
AI assistants
Simulation
QA careers

You want to be ready for AI testing. But what does that mean for your work?

Maybe your team is already experimenting with AI agents. Maybe you haven’t been asked to test one yet – but you’re wondering what you’ll need to learn when that happens. This session helps you understand what changes, where your QA experience fits, and how to get started.

This is for you if your team is already exploring AI, and...

  • You’re checking answers manually, but you’re not sure what you’re missing. You need a structured way to uncover failures beyond the conversations you thought to try.

  • You’re unsure what “pass” or “fail” should mean. When the same question gets different answers, you need clear criteria for deciding what’s acceptable.

  • You’re expected to help test it, but you haven’t done this before. You want to see a practical method in action so you know where to begin.

What if you haven’t tested AI yet, but…

  • You want to be prepared before it becomes part of your job. If your next project includes an AI agent, you want to contribute with confidence.

  • You use AI tools, but evaluating an AI system feels unfamiliar. You want to understand what to check and what a failure actually looks like.

  • You want your next career step to build on the experience you already have. You’re ready to learn new skills – you just need to know which ones and where to start.

This is why the market is in need for AI QA professionals

In the last few years, AI agents and chatbots have failed badly

An airline's chatbot

Invented a refund policy. Tribunal made the airline honour it.

A car dealer's chatbot

"Agreed" to sell a car for $1.

A delivery company's chatbot

Swore at a customer and criticised its own company.

A step-by-step method to start testing AI

Learn what to check, how to test it, and how to assess the results – with each step demonstrated live using Arato.

1. Define what good looks like

Write the rules an answer must meet: accurate, on-policy, on-tone, safe.

2. Design the conversations

Turn those rules into conversation scenarios and customer personas.

3. Run them at scale

Thousands of simulated customer conversations instead of ten hand-written chats.

4. Judge the results and decide

Score every answer against the rules, find the failure patterns, and decide if the agent is ready.

You’ve read plenty of posts about AI replacing testers.

You've read plenty of posts about AI replacing testers. This session looks at what's actually happening.

This session helps you understand what’s actually changing, without the hype, through insights from people who work directly on AI testing for companies and clients.

By the end of this session, you’ll understand:

  • Where AI agents go wrong
  • How to approach testing an AI agent
  • What AI testing looks like in practice
  • How to build on your QA experience
  • And get your question answered on the live Q&A.

What you walk away with

A method you can use

the four steps for testing an AI agent, from defining good to deciding if it's ready.

A LinkedIn Certificate of Attendance

"Testing AI Agents with Simulation", issued by Engenious University.

Your skills map

how the QA skills you have today become AI testing skills.

A head start

know how to test AI before your company brings it in, or before your next interview asks.

The Break Into AI Testing roadmap

your next steps for building AI testing skills.

The recording

plus a ready-to-post LinkedIn update to share with your certificate.

Attend live and add it to your LinkedIn profile

Certificate of Attendance: Testing AI Agents with Simulation, issued by Engenious University. Attend live for at least 45 minutes and we'll email it within 24 hours, with a button that adds it to LinkedIn under Licenses & Certifications.

Who's hosting

Engenious University is the learning arm of Engenious, a QA consulting company that has worked with Apple, Grammarly, Tinder and Expedia.

We help working QA professionals build the skills to test AI products, taught by people who still do the work.

What testers say after working with Engenious University

Anna Vysotskaya

Anna Vysotskaya

5.0

Rethink what 'pass/fail' means when it comes to AI

Just wrapped up an AI Testing course and it was super practical and eye-opening. Learned how to test models, spot hallucinations, and rethink what "pass/fail" means when it comes to AI.
Richard Cottrell

Richard Cottrell

5.0

An absolute masterclass for anyone transitioning from traditional QA into AI and LLMs

This 5-week course is an absolute masterclass for anyone transitioning from traditional QA into the world of AI and LLMs. It moves far beyond the hype to tackle the genuine technical challenges of testing non-deterministic solutions, providing a robust framework for building a real-world test strategy. What made this course stand out: 1. Deep-Dive Tooling: We got hands-on experience with Promptfoo and LM Studio, learning exactly how to leverage them for measurable results and why. 2. Red Teaming & Strategy: Moving from theory to the actual execution of Red Teaming was a highlight, as was the focus on the financial cost of different using different LLMs and testing approaches. 3. Practical 'Learn-See-Do' Format: The structure was excellent. Every session followed a clear 'concept demonstration group exercise' flow. Working through these concepts in breakout groups ensured the knowledge actually stuck. 4. Total Support: The flexibility of having recorded sessions was a lifesaver for busy weeks and having the tutors available via Discord throughout the 5 weeks meant no question went unanswered. If you want to understand how to actually validate AI performance and manage the risks of non-deterministic systems, this is the course you need. Highly recommended!

Show More

Kavita Jadhav

Kavita Jadhav

5.0

Moving beyond test automation into validating AI models directly

This course clearly outlined the future of QA — moving beyond test automation into validating AI models directly. 💡 I highly recommend it to QA professionals who want to upskill into AI Assurance and stay ahead of the curve. 📊 With practical case studies, frameworks, and portfolio-building guidance, it is both actionable and future-ready.

Show More

Vinutha Lingaraju

Vinutha Lingaraju

4.0

Working in QA and test automation, looking to expand into AI — a worthwhile step

I recently completed the AI course at Engenious University and overall it was a good learning experience. As someone working in the QA and test automation space and looking to expand into AI, I found the course a worthwhile step in that direction. The hands-on projects were definitely the strongest part of the programme. Being able to work through real problems rather than just absorbing theory made the concepts stick, and I came away with practical skills I can apply directly in my work.

Show More

Mariia Abramiuk

Mariia Abramiuk

5.0

Adversarial testing, bias detection, red teaming — hands-on, not just theory

Really glad I took this course. The instructors clearly know their craft and do a great job guiding you through complex material in a way that actually sticks. We covered adversarial testing, bias detection, red teaming, and multi-model evaluation using real tools like Promptfoo, Agenta AI, and Arato AI — hands-on, not just theory. Highly recommend for anyone serious about AI testing.

Show More

Anupama Kytham

Anupama Kytham

5.0

The technical skills and the mindset shift required to transition into AI/LLM testing

The 5-week LLM Testing Certification Program from Engenious University was an excellent learning journey that combined structure, depth, and real-world application. The curriculum was thoughtfully designed, starting with the fundamentals of LLM behavior and progressing into advanced areas such as prompt injections, hallucinations, bias, red-teaming, and compliance. What I found most valuable was the strong balance between theory and hands-on practice — every concept was reinforced with practical exercises using tools like Promptfoo and LangTest, which made the learning directly applicable to enterprise QA. The instructors, Igor Dorovskikh and Vladimir, brought clarity and industry context, ensuring the material was not only relevant but also actionable for today's AI-driven landscape. Overall, the program equips QA professionals with both the technical skills and the mindset shift required to transition into AI/LLM testing, and I would highly recommend it to anyone looking to stay ahead in the future of quality assurance.

Show More

Sharon O'Boyle

Sharon O'Boyle

5.0

Valuable new skills and a community of like-minded peers who continue to support and inspire me

An incredible learning journey! I loved learning how to test LLMs through practical exercises in group sessions and hands-on, real app testing. It's also been super valuable to get insights into what skills are really needed right now in the industry and how to prepare for interviews. The instructors are super passionate about what they do and genuinely care about everyone's progress. I finished with valuable new skills and a community of like-minded peers who continue to support and inspire me.

Show More

Anna Vysotskaya

Anna Vysotskaya

5.0

Rethink what 'pass/fail' means when it comes to AI

Just wrapped up an AI Testing course and it was super practical and eye-opening. Learned how to test models, spot hallucinations, and rethink what "pass/fail" means when it comes to AI.
Richard Cottrell

Richard Cottrell

5.0

An absolute masterclass for anyone transitioning from traditional QA into AI and LLMs

This 5-week course is an absolute masterclass for anyone transitioning from traditional QA into the world of AI and LLMs. It moves far beyond the hype to tackle the genuine technical challenges of testing non-deterministic solutions, providing a robust framework for building a real-world test strategy. What made this course stand out: 1. Deep-Dive Tooling: We got hands-on experience with Promptfoo and LM Studio, learning exactly how to leverage them for measurable results and why. 2. Red Teaming & Strategy: Moving from theory to the actual execution of Red Teaming was a highlight, as was the focus on the financial cost of different using different LLMs and testing approaches. 3. Practical 'Learn-See-Do' Format: The structure was excellent. Every session followed a clear 'concept demonstration group exercise' flow. Working through these concepts in breakout groups ensured the knowledge actually stuck. 4. Total Support: The flexibility of having recorded sessions was a lifesaver for busy weeks and having the tutors available via Discord throughout the 5 weeks meant no question went unanswered. If you want to understand how to actually validate AI performance and manage the risks of non-deterministic systems, this is the course you need. Highly recommended!

Show More

Kavita Jadhav

Kavita Jadhav

5.0

Moving beyond test automation into validating AI models directly

This course clearly outlined the future of QA — moving beyond test automation into validating AI models directly. 💡 I highly recommend it to QA professionals who want to upskill into AI Assurance and stay ahead of the curve. 📊 With practical case studies, frameworks, and portfolio-building guidance, it is both actionable and future-ready.

Show More

Vinutha Lingaraju

Vinutha Lingaraju

4.0

Working in QA and test automation, looking to expand into AI — a worthwhile step

I recently completed the AI course at Engenious University and overall it was a good learning experience. As someone working in the QA and test automation space and looking to expand into AI, I found the course a worthwhile step in that direction. The hands-on projects were definitely the strongest part of the programme. Being able to work through real problems rather than just absorbing theory made the concepts stick, and I came away with practical skills I can apply directly in my work.

Show More

Mariia Abramiuk

Mariia Abramiuk

5.0

Adversarial testing, bias detection, red teaming — hands-on, not just theory

Really glad I took this course. The instructors clearly know their craft and do a great job guiding you through complex material in a way that actually sticks. We covered adversarial testing, bias detection, red teaming, and multi-model evaluation using real tools like Promptfoo, Agenta AI, and Arato AI — hands-on, not just theory. Highly recommend for anyone serious about AI testing.

Show More

Anupama Kytham

Anupama Kytham

5.0

The technical skills and the mindset shift required to transition into AI/LLM testing

The 5-week LLM Testing Certification Program from Engenious University was an excellent learning journey that combined structure, depth, and real-world application. The curriculum was thoughtfully designed, starting with the fundamentals of LLM behavior and progressing into advanced areas such as prompt injections, hallucinations, bias, red-teaming, and compliance. What I found most valuable was the strong balance between theory and hands-on practice — every concept was reinforced with practical exercises using tools like Promptfoo and LangTest, which made the learning directly applicable to enterprise QA. The instructors, Igor Dorovskikh and Vladimir, brought clarity and industry context, ensuring the material was not only relevant but also actionable for today's AI-driven landscape. Overall, the program equips QA professionals with both the technical skills and the mindset shift required to transition into AI/LLM testing, and I would highly recommend it to anyone looking to stay ahead in the future of quality assurance.

Show More

Sharon O'Boyle

Sharon O'Boyle

5.0

Valuable new skills and a community of like-minded peers who continue to support and inspire me

An incredible learning journey! I loved learning how to test LLMs through practical exercises in group sessions and hands-on, real app testing. It's also been super valuable to get insights into what skills are really needed right now in the industry and how to prepare for interviews. The instructors are super passionate about what they do and genuinely care about everyone's progress. I finished with valuable new skills and a community of like-minded peers who continue to support and inspire me.

Show More

Meet *Jaime*

Your Host – November 19th

Meet Jaime

Jaime Mantilla is a Senior Automation Architect and mentor at Engenious University, with 14+ years in software engineering, quality assurance and automation. He has led teams, designed test strategies and built automation frameworks across industries, working with AI-driven testing approaches and cloud technologies for enterprise clients and Fortune 500 companies.

  • 14+ years in software engineering, QA and automation

  • Designs test strategies and builds automation frameworks

  • Works with AI-driven testing approaches and cloud technologies

  • Mentor at Engenious University

Engenious UniversityTest AutomationAI Testing
LinkedIn
Meet *Oren*

Your Guest – November 19th

Meet Oren

Oren Stern is the Chief Business Officer at Arato.ai, with 25+ years scaling revenue, partnerships and product strategy. Arato is an Israeli company that tests AI agents by running thousands of simulated conversations through a product's own interface. Engenious University uses Arato in its AI testing course.

  • Chief Business Officer at Arato.ai

  • Built monday.com's channel business to $100M and a successful IPO

  • Founded Kenshoo's eComm business, from inception to $40M

  • Led P&L for Verint's $700M enterprise business

Aratomonday.comKenshooVerint
LinkedIn

Is this for you?

Come if

  • You write test cases, run regression or sign off releases, whether manual or automated

  • Someone has asked "how do we test the AI?" and nobody had a clear answer

  • Your team is adding a chatbot, assistant or AI feature, and the testing is landing on your desk

  • Your company hasn't started with AI yet, and you want to be ready before it does

  • You keep seeing "AI testing" or "LLM evaluation" in job posts and want to know what's behind them

  • You want to build on your QA experience, not start over as a developer

  • You learn best by watching it done on a real example

Get clear in 60 minutes

  • Understand how AI agents can go wrong

  • Learn a four-step process for testing them

  • Watch that process in a live demo

  • Get a certificate of attendance, a map of the skills you need, and a roadmap for what to learn next

FAQ

Thursday, November 19th, at 10 AM PST / 1 PM EST / 7 PM CET. Live on Zoom, 60 minutes.

QA professionals, SDETs and automation engineers. QE leaders are welcome.

Yes. Many of the people joining are in the same place. You'll learn what AI testing involves now, so you're ready when your company starts or when you look for your next role.

No. If you've tested software, you'll be able to follow everything.

You'll learn the method and see it done live on a real example. To build the skill hands-on, the roadmap you receive shows the steps.

Attend live for at least 45 minutes. It arrives by email within 24 hours with a button to add it to LinkedIn.

No. It's a certificate of attendance from Engenious University.

Yes. Everyone who registers gets the recording.

Our guest. Arato builds simulation testing for AI agents, and we use it in our AI testing course.

No. You'll see a real problem, a real method and a real tool. The roadmap and certificate are yours either way.

Your QA experience is the head start. Here's how to use it.

Companies are launching AI agents every week, and many are still tested with a handful of chats. Testers who can check them properly are becoming increasingly valuable.

Whether your company has started with AI or not, in 60 minutes you'll see how AI agents are tested and where to start building the skills yourself.

Thu, Nov 19 · Live · Free · LinkedIn certificate

Engenious University: where QA professionals become the most wanted testers of the AI era.

Ask question