PyCon Portugal 2026

Audit and evaluate AI generated Python code

These may be the most important skills to keep your job or to find a new one in the future!

AI-generated code is a powerful tool, but it should never be blindly trusted. This intensive workshop, "Audit and evaluate AI generated Python code," teaches you the critical skills you need to stay relevant in the future.


These may be the most important skills to keep your job or to find a new one in the future!

AI-generated code is a powerful tool, but it should never be blindly trusted. This intensive workshop, "Audit and evaluate AI generated Python code," teaches you the critical skills you need to stay relevant in the future: how to ensure AI-generated code is secure, functional, and aligns with your standards.

We will go beyond basic reviews with a four-step, hands-on approach. You will learn how to:
Perform Functional Verification using tools like pytest and hypothesis for property-based testing;
Conduct Security & Dependency Audits with static analysis tools;
Execute an Adversarial Review by attacking your own program; and
Achieve Architectural Alignment using ruff and type checking with ty.

Finally, we will cover how to measure and document the performance of your AI prompts using evaluation metrics. You’ll leave this workshop prepared to take control of code that AI produces in your Python projects, and learn how to turn this code into quality code.

This workshop is specifically designed for developers who have already begun incorporating AI into their workflow to generate code and are looking to refine their auditing process.


Audience Level: Intermediate What are the main topics of your talk?:

AI, Security, Career development