多模态AI辅导平台让摄像头实时查看手写数学过程:随机在线研究比较三种辅导方式
Exploring Visual Access and Proactive AI Tutoring for Handwritten Mathematics
Nachiket Kotalwar 等人在 arXiv 发布预印本(尚未完成同行评审),构建了一个多模态 AI 辅导平台,用手机摄像头让辅导系统实时查看学习者在纸上的手写解题过程。
该预印本报告了一项随机在线研究,比较三种辅导条件,并公开平台、提示词、工具与带时间戳的手写图像数据,可供关注多模态学习分析与AI辅导干预时机的研究者参考。
arXiv:2610.26411v1 Announce Type: cross Abstract: Handwritten work captures mathematical reasoning that learners may not express in typed or voice-dictated messages. We built a multimodal AI tutoring platform in which a phone camera gives the tutor a live view of learners' work on paper. In a randomized online study, 117 adults solved calculus problems with Text-Reactive, Visual-Reactive, or Visual-Proactive assistance. Analysis of 2,140 tutor messages showed that visual access shifted assistance toward checking ongoing work, while proactivity enhanced error identification and directive hints. Learners valued feedback grounded in their writing; those who received proactive help rated it as supportive, and about a third wanted it more often. These findings inform when tutors should intervene and what they should address. We release the platform, prompts, and instruments, together with 255,984 timestamped images of handwritten work linked to tutoring conversations, intervention decisions, and learning outcomes, to support multimodal tutoring systems that preserve the affordances of handwritten work while providing adaptive feedback.
中文翻译还没有生成,先显示原文。
来源:arXiv · Human-Computer Interaction · arxiv.org