UnexpectedParrots：用硅内模拟迭代行为实验设计
UnexpectedParrots: Iterating Behavioral Experiment Design with In-Silico Simulations
据 arXiv 预印本（未完成同行评审），UnexpectedParrots 利用 LLM 参与者的推理轨迹与回答，在招募真人被试前迭代改进行为研究设计，指出结构性错误与被忽视的机会。
arXiv:2610.25343v1 Announce Type: new Abstract: Running behavioral experiments is expensive, slow, and prone to design flaws, often detectable after collecting data. We introduce UnexpectedParrots to iteratively refine behavioral study designs before a researcher recruits costly human participants. UnexpectedParrots relies on reasoning traces in addition to responses from LLM participants to uncover diagnostic critiques of structural errors and missed opportunities in existing study designs. When evaluated against a human-pilot or a no-simulation design-only baseline, UnexpectedParrots adds most value, producing unique, high-quality critiques. In a moderated user study with 12 proficient researchers, we find UnexpectedParrots useful, time-saving, and thought-provoking. Critiques provided by UnexpectedParrots often converge on issues researchers identify only during independent human pilots or additional formative interviews, even when the fidelity of the simulated populations remains questionable. Our users deem UnexpectedParrots useful not only as a tool to conduct early pilot studies and identify errors but also as an ideation tool to expand one's research horizon.
中文翻译还没有生成，先显示原文。
来源：arXiv · Human-Computer Interaction · arxiv.org