General

PyFi: Toward Pyramid-like Financial Image Understanding for VLMs via Adversarial Agents

Reading time: 1 minute
...

📝 Original Info

  • Title: PyFi: Toward Pyramid-like Financial Image Understanding for VLMs via Adversarial Agents
  • ArXiv ID: 2512.14735
  • Date: 2025-12-11
  • Authors: Yuqun Zhang, Yuxuan Zhao, Sijia Chen

📝 Abstract

This paper proposes PyFi, a novel framework for pyramid-like financial image understanding that enables vision language models (VLMs) to reason through question chains in a progressive, simple-to-complex manner. At the core of PyFi is PyFi-600K, a dataset comprising 600K financial question-answer pairs organized into a reasoning pyramid: questions at the base require only basic perception, while those toward the apex demand increasing levels of capability in financial visual understanding and expertise. This data is scalable because it is synthesized without human annotations, using PyFi-adv, a multi-agent adversarial mechanism under the Monte Carlo Tree Search (MCTS) paradigm, in which, for each image, a challenger agent competes with a solver agent by generating question chains that progressively probe deeper capability levels in financial visual reasoning. Leveraging this dataset, we present fine-grained, hierarchical, and comprehensive evaluations of advanced VLMs in the financial domain. Moreover, finetuning Qwen2.5-VL-3B and Qwen2.5-VL-7B on the pyramid-structured question chains enables these models to answer complex financial questions by decomposing them into subquestions with gradually increasing reasoning demands, yie...

📄 Full Content

...(본문 내용이 길어 생략되었습니다. 사이트에서 전문을 확인해 주세요.)

Start searching

Enter keywords to search articles

↑↓
↵
ESC
⌘K Shortcut