Anthony Peng

Research Projects

VeriWorld: A Verifiable Visual SWE-Bench for Spatial Reasoning in 3D Environments
Yan Zheng, ShengYun Peng , Xuyao Liang, Xiaoyan Cong, Nuo Chen, Bangya Liu, Zihan Wang, Wenyan Cong, Zhiwen Fan, Zhangyang Wang
NeurIPS Evaluations & Datasets Track, 2026
Coming soon!
Large Reasoning Models Learn Better Alignment from Flawed Thinking
ShengYun Peng , Pin-Yu Chen, Eric Smith, Song Jiang, Hongyuan Zhan, Haozhu Wang, Mahesh Pasupuleti, Duen Horng Chau, Jianfeng Chi
EMNLP, 2026
PDF Code Oral #2 paper of the day 🤗 Went Viral on X (👁 26K+)
UNIPO: Unified Interactive Visual Explanation for RL Fine-Tuning Policy Optimization
Aeree Cho, Alexander D. Greenhalgh, Jonathan Bodea, ShengYun Peng , Duen Horng Chau
VIS, 2026
Demo PDF Code Best Short Paper Honorable Mention
Differentiable Rendering Powered End-to-End Adversarial Attack Evaluation
Mansi Phute, Matthew Hull, Haoran Wang, Alec Helbling, ShengYun Peng , Willian Lunardi, Martin Andreoni, Wenke Lee, Duen Horng Chau
PAKDD, 2026
PDF Oral
Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety
Seongmin Lee, Aeree Cho, Grace Kim, ShengYun Peng , Mansi Phute, Duen Horng Chau
EMNLP, 2025
PDF Went Viral on LinkedIn (❤️ 340+)
Shape it Up! Restoring LLM Safety during Finetuning
ShengYun Peng , Pin-Yu Chen, Jianfeng Chi, Seongmin Lee, Duen Horng Chau
NeurIPS, 2025
PDF Code
LLM Attributor: Interactive Visual Attribution for LLM Generation
Seongmin Lee, Zijie J. Wang, Aishwarya Chakravarthy, Alec Helbling, ShengYun Peng , Mansi Phute, Duen Horng Chau, Minsuk Kahng
AAAI Demo, 2025
PDF Code Video
CompCap: Improving Multimodal Large Language Models with Composite Captions
Xiaohui Chen, Satya Shukla, Mahmoud Azab, Aashu Singh, Qifan Wang, David Yang, ShengYun Peng, Hanchao Yu, Shen Yan, Xuewen Zhang, Baosheng He
ICCV, 2025
PDF
Inference Compute-Optimal Video Vision Language Models
Peiqi Wang, ShengYun Peng, Xuewen Zhang, Hanchao Yu, Yibo Yang, Lifu Huang, Fujun Liu, Qifan Wang
ACL, 2025
PDF Code Video
Navigating the Safety Landscape: Measuring Risks in Finetuning Large Language Models
ShengYun Peng , Pin-Yu Chen, Matthew Hull, Duen Horng Chau
NeurIPS, 2024
PDF Code Went Viral on X (👁 21K+)
UniTable: Towards a Unified Framework for Table Recognition via Self-Supervised Pretraining
ShengYun Peng , Aishwarya Chakravarthy, Seongmin Lee, Xiaojing Wang, Rajarajeswari Balasubramaniyan, Duen Horng Chau
NeurIPS TRL Workshop, 2024
PDF Code Powering open-parse (★3.2k), a leading LLM file parsing library
Self-supervised Pre-training for Table Structure Recognition Transformer
ShengYun Peng , Seongmin Lee, Xiaojing Wang, Raji Balasubramaniyan, Duen Horng Chau
AAAI SDU Workshop, 2024
PDF Code Oral
High-Performance Transformers for Table Structure Recognition Need Early Convolutions
ShengYun Peng , Seongmin Lee, Xiaojing Wang, Raji Balasubramaniyan, Duen Horng Chau
NeurIPS TRL Workshop, 2023
PDF Code Oral
LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked
Mansi Phute, Alec Helbling, Matthew Hull, ShengYun Peng , Sebastian Szyller, Cory Cornelius, Duen Horng Chau
ICLR Tiny Papers Track, 2024
PDF Code Deployed by ADP
Robust Principles: Architectural Design Principles for Adversarially Robust CNNs
ShengYun Peng , Weilin Xu, Cory Cornelius, Matthew Hull, Kevin Li, Rahul Duggal, Mansi Phute, Jason Martin, Duen Horng Chau
BMVC, 2023
PDF Code Video Poster Best Poster (Paper) Award #1 on RobustBench CIFAR-10 Leaderboard (2023)
Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion
Seongmin Lee, Benjamin Hoover, Hendrik Strobelt, Zijie J. Wang, ShengYun Peng , Austin Wright, Kevin Li, Haekyu Park, Haoyang Yang, Duen Horng Chau
IEEE Visualization Conference (VIS), 2024
Demo PDF Code Video
SkeleVision: Towards Adversarial Resiliency of Person Tracking with Multi-Task Learning
Nilaksh Das, ShengYun Peng , Duen Horng Chau
ECCV AROW Workshop, 2022
PDF Code
DetectorDetective: Investigating the Effects of Adversarial Examples on Object Detectors
Interactive visualization tool for adversarial object detectors
CVPR Demo, 2022
PDF
A novel DNN tracking algorithm for structural system identification
ShengYun Peng , LingFeng Yan, Bin He, Ying Zhou
Smart Structures and Systems, 2021
PDF Video
DSiamMFT: An RGB-T fusion tracking method via dynamic Siamese networks using multi-layer feature fusion
Xingchen Zhang, Ping Ye, ShengYun Peng , Jun Liu, Gang Xiao
Signal Processing, Image Communication, 2020
PDF
Anti-occlusion object tracking based on correlation filter
Jun Liu, Gang Xiao, Xingchen Zhang, Ping Ye, Xingzhong Xiong, ShengYun Peng
Signal, Image and Video Processing, 2019
PDF
SiamFT: An RGB-Infrared Fusion Tracking Method via Fully Convolutional Siamese Networks
Xingchen Zhang, Ping Ye, ShengYun Peng , Jun Liu , Ke Gong , Gang Xiao
IEEE Access, 2019
PDF
Object Fusion Tracking Based on Visible and Infrared Images Using Fully Convolutional Siamese Networks
Xingchen Zhang, Ping Ye, Dan Qiao, Junhao Zhao, ShengYun Peng , Gang Xiao
22nd International Conference on Information Fusion (FUSION), 2019
PDF
arXiv preprint, 2020
PDF
arXiv preprint, 2022
PDF
arXiv preprint, 2023
PDF
IJCAI Demo, 2024
Demo PDF Code Video
arXiv preprint, 2024
PDF