Demonstrating the return on investment of training programs is an important, though often intimidating, challenge in L&D. Even when we understand what a Level 4 evaluation requires, the lack of statistical background or data infrastructure makes it difficult to execute. This session makes that work more accessible.

Using real and synthetic datasets, participants will work through an end-to-end workflow for using AI tools to analyze training data, interpret results, and communicate impact—all without a statistics degree. We'll cover what to measure and how to work with the data you actually have, how to use AI to clean messy datasets, key data governance considerations for practitioners working with institutional data, and how to use large language models to run analyses, explain statistical results in plain language, and generate compelling visualizations. Throughout, we will touch on some statistical foundations, like what t-tests tell us, to help you ask the right questions and trust your conclusions.

Whether you are constructing a Level 4 evaluation from scratch or trying to make sense of data (however messy) you already have, you'll leave with practical tools and a workflow you can apply immediately.

In this session, you will:

• Identify the opportunities and constraints for leveraging AI to conduct Level 4 evaluations in your organizational context
  
• Leverage large language models to clean messy data, perform statistical analyses, interpret results in plain language, and generate data visualizations.
  
• Articulate basic statistical concepts (like what t-tests measure) well enough to communicate findings to organizational stakeholders.

About our Speaker

Eric de Araujo, PhD is a Lead Instructional Designer at Purdue University, where he works at the intersection of online learning, faculty development, artificial intelligence, and data-informed decision making. With a background spanning philosophy, program development, and applied AI, he brings both theoretical grounding and practical experience to the challenges facing today's L&D professionals.

Eric has developed AI-powered tools that streamline learning design workflows and has presented on AI applications in education and training at universities and national conferences including OLC Accelerate and UPCEA. He recently completed the Data Science Methods for Digital Learning Platforms graduate certificate at the University of Pennsylvania. 

Part of his current work focuses on using AI to make data analysis accessible to learning professionals who are not trained data scientists.

Connect with Dr. de Araujo on LinkedIn