Abstract
Table Question Answering (TableQA) aims to reason over tables to answer user queries. Existing research treats all questions uniformly and evaluates solely through overall accuracy, obscuring a critical reality that LLMs excel at simple lookups yet struggle with complex operations like aggregation and arithmetic. To reveal this disparity, we introduce a novel Operation-wise TableQA task with a fine-grained question taxonomy and release two datasets named WikiTQ-ow and TabFact-ow for evaluation.
As for modeling bottlenecks, existing methods flatten tables into linearized texts, disrupting inherent structures and inducing the 'lost-in-the-middle' issue, which poses a primary barrier to complex cross-row reasoning. Moreover, they typically reason from scratch, neglecting reusable patterns shared across similar operations. To address these limitations, we propose a Skill-augmented Table Graph Reasoning (SkillTGR) framework for self-evolving structured reasoning.
Specifically, SkillTGR represents tables as attributed graphs with explicit row-column-cell structures, where LLMs plan and execute dynamic chains to retrieve evidence subgraphs for graph traversal reasoning. Based on this, SkillTGR builds a hierarchical SkillBank to distill reason trajectories into abstract skills under cognitive heuristics, then hybrid retrieves both successful and failed skills for contrastive augmented table graph reasoning, thereby enabling the continual self-evolution. Extensive experiments demonstrate that SkillTGR achieves superior performance with an average of 5.91% overall and 6.03% operation-wise improvement, also reducing 19.76% token consumption and 27.64% inference latency. Our codes and data will be released upon publication.
Blogger's Review: The SkillTGR framework leverages the inherent properties of tables by representing them as graph structures and introducing an augmented reasoning approach. This not only enhances the accuracy of question answering but also effectively reduces resource consumption, showcasing the advancement and future direction in the field of table reasoning. The fine-grained evaluation at the operation level provides significant reference value for subsequent research.