Pengxiang LI

I am a second-year PhD student in Beijing Institute of Technology (BIT), advised by Dr. Yuwei Wu and Dr. Yunde Jia. I am also a member of the joint PhD program (‘TONG Program’) with Beijing Institute for General Artificial Intelligence (BIGAI), and I am grateful to be advised by Dr. Qing Li and Dr. Zhi Gao. Previously, I got my Bachelor’s degree in Computer Science and Technology from BIT in 2021.
My research interests lie in Multimodal Agents, Non-Euclidean Optimization, and 3DV Understanding. Feel free to reach out if you are interested in my work or have any questions! 🤝

News

2025-01	🌟 One paper on Multimodal Agent Tuning is accepted by ICLR 2025 Spotlight.
2024-10	🌟 One paper on Feedback Learning in VLM is accepted by NeurIPS 2024.
2024-09	🌟 One journal paper on Stereo Matching is accepted by T-CSVT.

Publications

Iterative Tool Usage Exploration for Multimodal Agents via Step-wise Preference Tuning

Pengxiang Li* , Zhi Gao* , Bofei Zhang , Yapeng Mi , Xiaojian Ma , Chenrui Shi , Tao Yuan , Yuwei Wu^✉ , Yunde Jia , Song-Chun Zhu , and Qing Li^✉

arXiv preprint arXiv:2504.21561, 2025

arXiv Bib Website

@article{2025iterative,
  title = {Iterative Tool Usage Exploration for Multimodal Agents via Step-wise Preference Tuning },
  author = {Li, Pengxiang and Gao, Zhi and Zhang, Bofei and Mi, Yapeng and Ma, Xiaojian and Shi, Chenrui and Yuan, Tao and Wu, Yuwei and Jia, Yunde and Zhu, Song-Chun and Li, Qing},
  equalauthor = { Li, Pengxiang and Gao, Zhi},
  journal = {arXiv preprint arXiv:2504.21561},
  year = {2025},
  correspondence = {Wu, Yuwei and Li, Qing},
}

Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage Spotlight

Zhi Gao* , Bofei Zhang* , Pengxiang Li* , Xiaojian Ma , Tao Yuan , Yue Fan , Yuwei Wu^✉ , Yunde Jia , Song-Chun Zhu , and Qing Li^✉

International Conference on Learning Representations (ICLR), 2025

Bib Website

Spotlight

@article{2025mat,
  title = {Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage},
  author = {Gao, Zhi and Zhang, Bofei and Li, Pengxiang and Ma, Xiaojian and Yuan, Tao and Fan, Yue and Wu, Yuwei and Jia, Yunde and Zhu, Song-Chun and Li, Qing},
  equalauthor = {Gao, Zhi and Zhang, Bofei and Li, Pengxiang},
  correspondence = {Wu, Yuwei and Li, Qing},
  year = {2025},
  journal = {International Conference on Learning Representations (ICLR)},
}

Task-oriented Sequential Grounding in 3D Scenes

Zhuofan Zhang , Ziyu Zhu , Pengxiang Li , Tengyu Liu , Xiaojian Ma , Yixin Chen , Baoxiong Jia , Siyuan Huang , and Qing Li^✉

arXiv preprint arXiv:2408.04034, 2024

arXiv Bib Website

@article{2024sg3d,
  title = {Task-oriented Sequential Grounding in 3D Scenes},
  author = {Zhang, Zhuofan and Zhu, Ziyu and Li, Pengxiang and Liu, Tengyu and Ma, Xiaojian and Chen, Yixin and Jia, Baoxiong and Huang, Siyuan and Li, Qing},
  journal = {arXiv preprint arXiv:2408.04034},
  year = {2024},
  correspondence = {Wu, Yuwei and Li, Qing},
}

FIRE: A Dataset for Feedback Integration and Refinement Evaluation of Multimodal Models

Pengxiang Li* , Zhi Gao* , Bofei Zhang* , Tao Yuan , Yuwei Wu^✉ , Mehrtash Harandi , Yunde Jia , Song-Chun Zhu , and Qing Li^✉

Neural Information Processing Systems: Datasets and Benchmarks (NeurIPS D&B), 2024

arXiv Bib Website

@article{2024fire,
  title = {FIRE: A Dataset for Feedback Integration and Refinement Evaluation of Multimodal Models},
  author = {Li, Pengxiang and Gao, Zhi and Zhang, Bofei and Yuan, Tao and Wu, Yuwei and Harandi, Mehrtash and Jia, Yunde and Zhu, Song-Chun and Li, Qing},
  journal = {Neural Information Processing Systems: Datasets and Benchmarks (NeurIPS D&B)},
  year = {2024},
  equalauthor = {Li, Pengxiang and Gao, Zhi and Zhang, Bofei},
  correspondence = {Wu, Yuwei and Li, Qing},
}

Inter-Scale Similarity Guided Cost Aggregation for Stereo Matching

Pengxiang Li , Chengtang Yao , Yuwei Wu^✉ , and Yunde Jia

IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2024

Bib

@article{2024issga,
  title = {Inter-Scale Similarity Guided Cost Aggregation for Stereo Matching},
  author = {Li, Pengxiang and Yao, Chengtang and Wu, Yuwei and Jia, Yunde},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)},
  year = {2024},
  correspondence = {Wu, Yuwei},
  paper = {https://ieeexplore.ieee.org/document/10663688},
}

Hyperbolic Learning: Theory and Applications

Pengxiang Li , Peilin Yu , Yangkai Xue , Yuwei Wu , and Zhi Gao

2023

Bib Slides

A decomposition model for stereo matching

Chengtang Yao , Yunde Jia , Huijun Di , Pengxiang Li , and Yuwei Wu^✉

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021

arXiv Bib

@article{yao2021decomposition,
  title = {A decomposition model for stereo matching},
  author = {Yao, Chengtang and Jia, Yunde and Di, Huijun and Li, Pengxiang and Wu, Yuwei},
  journal = {The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  year = {2021},
  correspondence = {Wu, Yuwei},
}

Education

2023 - Present

Joint PhD Program with Beijing Institute for General Artificial Intelligence (BIGAI), China

2023 - Present

PhD student in Computer Science, Beijing Institute of Technology (BIT), China

2021 - 2023

MSc in Computer Science, Beijing Institute of Technology (BIT), China

2017 - 2021

BSc in Computer Science, Beijing Institute of Technology (BIT), China