NeFut Logo NeFut
Admin Login

[CS.AI] TsuGO: Probing Search Efficiency in LLM Reasoning via Go Life-and-Death Problems

Published at: 2026-08-15 22:00 Last updated: 2026-08-16 07:03
#LLM #Open Source #Artificial Intelligence

TsuGO is a new process-level LLM reasoning benchmark for evaluating Search Efficiency in LLM reasoning through Go life-and-death problems. These problems provide closed and verifiable solution spaces with an inherent adversarial structure, making candidate generation, response checking, branch comparison, and backtracking necessary parts of reasoning. By constraining the solution space, TsuGO disentangles domain knowledge from search organization, parses CoT into a structured search tree, and reports Search Efficiency together with Token Efficiency and other diagnostic metrics and visualizations. Experiments show that current LLMs remain far from stable tsumego solving: stronger models succeed by finding the correct candidate earlier and sustaining effort on productive branches, but most models still behave much closer to unguided search algorithms than to neural-guided KataGo. Longer CoT or higher Token Efficiency does not necessarily imply better search. Our results identify search organization and reasoning-resource allocation as missing dimensions in LLM reasoning evaluation. Blogger's Review: TsuGO provides a new perspective on evaluating LLM's search efficiency, using Go life-and-death problems to assess LLM's search capability, revealing the importance of search organization and resource allocation in LLM reasoning.

Original Source: https://arxiv.org/abs/2608.13221

[h] Back to Home