Are We Asking the Right Questions? On Ambiguity in Natural Language Queries for Tabular Data Analysis

📝 Original Info

• Title: Are We Asking the Right Questions? On Ambiguity in Natural Language Queries for Tabular Data Analysis
• ArXiv ID: 2511.04584
• Date: 2025-11-06
• Authors: 정보 제공되지 않음 (원고에 저자 명단이 포함되어 있지 않음)

📝 Abstract

Natural language interfaces to tabular data must handle ambiguities inherent to queries. Instead of treating ambiguity as a deficiency, we reframe it as a feature of cooperative interaction where users are intentional about the degree to which they specify queries. We develop a principled framework based on a shared responsibility of query specification between user and system, distinguishing unambiguous and ambiguous cooperative queries, which systems can resolve through reasonable inference, from uncooperative queries that cannot be resolved. Applying the framework to evaluations for tabular question answering and analysis, we analyze the queries in 15 popular datasets, and observe an uncontrolled mixing of query types neither adequate for evaluating a system's execution accuracy nor for evaluating interpretation capabilities. This conceptualization around cooperation in resolving queries informs how to design and evaluate natural language interfaces for tabular data analysis, for which we distill concrete directions for future research and broader implications.

💡 Deep Analysis

📄 Full Content

Reference