Knowns and Unknowns: Testing AI Generated Code

Hosted by: Orlando Java User Group (JUG)

Let's face it AI-assisted coding is rapidly becoming the primary way applications are being written. The power of being able to write out a complicated application or feature with a just a few commands is something too alluring to pass up.

But between the imprecise nature of language and LLMs ability to "hallucinate", this creates many opportunities for bugs and unintended behavior to introduced. Just telling an AI coding agent to "write tests" isn't going to be enough to build confidence in the correctness of an application either.

In this presentation we are going to review three distinct phases to testing AI written code. The known knowns; using spec driven development to define the business meaningful behavior of your application. Known unknowns; using property-based testing to handle edge cases and avoid over fitting and unintended biases. And finally unknown unknowns, using static analysis and mutation testing to avoid introducing bugs you didn't think about.

AI-assisted coding is a rapidly evolving field, but this presentation should give you the framework and approach on how to have confidence when using AI to assist in writing applications.

• 6:30pm — Welcome & Networking: Pizza, drinks and name tags will be provided—come hungry and ready to connect!
• 7:00pm — Get people into the auditorium.
• 7:05pm — Orlando JUG and ODevs opening remarks.
• 7:10pm — Featured presentation by guest speaker.
• 8:20pm — Q&A + Social Time. Two attendees will each win a JetBrains license (e.g. IntelliJ IDEA, CLion, PyCharm Pro, ReSharper, etc.) and 3 attendees will each win an O'Reilly book.