Exploring User-Centered Design and Usability Testing of MathPal: an AI Agent for Math Learning

Zilong Pan, Yiwen Wu, Adam Wax, Benjamin Rainey, Faatiha Kalam, Jolie Goldstein, Zilu Jiang, Chenglu Li

Iterative usability testing with both teachers and students ensures that generative AI learning tools align with real classroom needs.

What it found

This study investigated the user-centered development of MathPal, a generative AI agent built to offer conceptual and metacognitive math support for high schoolers. Researchers conducted two rounds of usability testing involving both students and teachers to iteratively refine the agent's interaction design. The findings demonstrate that co-designing with educators and learners helps align AI behaviors with actual classroom environments and user expectations.

What it means for your work

When designing generative AI learning agents, instructional designers should include both educators and learners in iterative usability testing cycles. Rather than relying solely on technological capabilities, focus on how the AI's dialogue flow supports specific metacognitive and pedagogical goals. This dual-user feedback loop ensures the tool is both practical for teachers to implement and intuitive for students to use.

Related studies

Summaries are generated automatically from the publisher's abstract or article text. Always check the original source before citing.