ShengYun (Anthony) Peng


Education

Ph.D. in Computer Science
Georgia Institute of Technology, Atlanta, GA
M.S. in Computer Science
Georgia Institute of Technology, Atlanta, GA
B.Eng. in Civil Engineering
Tongji University, Shanghai, China
Outstanding Graduates Award of Shanghai
Cross-disciplinary Scholars in Science and Technology (CSST) Program
University of California, Los Angeles, Los Angeles, CA

Industry Experience

Nvidia, Santa Clara, CA
Research Scientist Intern
Meta, New York, NY
Research Scientist Intern
Meta, Menlo Park, CA
Research Scientist Intern
IBM Research, Yorktown Heights, NY
Research Scientist Intern
Intel, Hillsboro, OR
Research Scientist Intern

Awards and Honors

Oral Paper Award
UNDREAM is an oral presentation at PAKDD 2026
Oral Paper Award
UniTable is an oral presentation at NeurIPS 2024 Workshop
Oral Paper Award
Self-supervised table structure recognition is an oral presentation at AAAI 2024 Workshop
Oral Paper Award
Transformer for table structure recognition is an oral presentation at NeurIPS 2023 Workshop
BMVC 2023 Best Poster Award
Only five of the accepted papers are selected for the award
Outstanding Gradutes in Shanghai
For top 5% undergraduates graduating in 2020.
National Scholarship
Stipend awarded to top 2% undergraduates in all China's universities.
Tongji University Excellent Student
For top 5% undergraduates in Tongji University.
First Prize of Tongji University Scholarship of Excellence
For outstanding undergraduates in Tongji University.

Publications

UNDREAM: Bridging Differentiable Rendering and Photorealistic Simulation for End-to-end Adversarial Attacks
Mansi Phute, Matthew Hull, Haoran Wang, Alec Helbling, ShengYun Peng, Willian Lunardi, Martin Andreoni, Wenke Lee, Duen Horng Chau
PAKDD. 2026.
Project PDF BibTeX Oral
Large Reasoning Models Learn Better Alignment from Flawed Thinking
ShengYun Peng, Eric Smith, Ivan Evtimov, Song Jiang, Pin-Yu Chen, Hongyuan Zhan, Haozhu Wang, Duen Horng Chau, Mahesh Pasupuleti, Jianfeng Chi
In submission. 2026.
Project PDF Code BibTeX #2 paper of the day 🤗 Went Viral on X (👁 26K+)
Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety
Seongmin Lee, Aeree Cho, Grace Kim, ShengYun Peng, Mansi Phute, Duen Horng Chau
EMNLP. 2025.
Project PDF BibTeX Went Viral on LinkedIn (❤️ 340+)
Shape it Up! Restoring LLM Safety during Finetuning
ShengYun Peng, Pin-Yu Chen, Jianfeng Chi, Seongmin Lee, Duen Horng Chau
NeurIPS. 2025.
Project PDF Code BibTeX
LLM Attributor: Interactive Visual Attribution for LLM Generation
Seongmin Lee, Zijie J. Wang, Aishwarya Chakravarthy, Alec Helbling, ShengYun Peng, Mansi Phute, Duen Horng Polo Chau, Minsuk Kahng
AAAI Demo. 2025.
Project PDF Code(★78) Video BibTeX
CompCap: Improving Multimodal Large Language Models with Composite Captions
Xiaohui Chen, Satya Shukla, Mahmoud Azab, Aashu Singh, Qifan Wang, David Yang, ShengYun Peng, Hanchao Yu, Shen Yan, Xuewen Zhang, Baosheng He
ICCV. 2025.
Project PDF BibTeX
Inference Compute-Optimal Video Vision Language Models
Peiqi Wang, ShengYun Peng, Xuewen Zhang, Hanchao Yu, Yibo Yang, Lifu Huang, Fujun Liu, Qifan Wang
ACL. 2025.
Project PDF Code Video BibTeX
Navigating the Safety Landscape: Measuring Risks in Finetuning Large Language Models
ShengYun Peng, Pin-Yu Chen, Matthew Hull, Duen Horng Chau
NeurIPS. 2024.
Project PDF Code BibTeX Went Viral on X (👁 21K+)
UniTable: Towards a Unified Framework for Table Structure Recognition via Self-Supervised Pretraining
ShengYun Peng, Seongmin Lee, Xiaojing Wang, Raji Balasubramaniyan, Duen Horng Chau
NeurIPS TRL Workshop. 2024.
Project PDF Code(★527) BibTeX Powering open-parse (★3.2k), a leading LLM file parsing library
Self-supervised Pre-training for Table Structure Recognition Transformer
ShengYun Peng, Seongmin Lee, Xiaojing Wang, Raji Balasubramaniyan, Duen Horng Chau
AAAI SDU Workshop. 2024.
Project PDF Code(★527) BibTeX Oral
High-Performance Transformers for Table Structure Recognition Need Early Convolutions
ShengYun Peng, Seongmin Lee, Xiaojing Wang, Raji Balasubramaniyan, Duen Horng Chau
NeurIPS TRL Workshop. 2023.
Project PDF Code BibTeX Oral
LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked
Mansi Phute, Alec Helbling, Matthew Hull, ShengYun Peng, Sebastian Szyller, Cory Cornelius, Duen Horng Chau
ICLR Tiny Papers Track. 2024.
Project PDF Code(★51) BibTeX Deployed by ADP
Robust Principles: Architectural Design Principles for Adversarially Robust CNNs
ShengYun Peng, Weilin Xu, Cory Cornelius, Matthew Hull, Kevin Li, Rahul Duggal, Mansi Phute, Duen Horng Chau, Jason Martin
BMVC. 2023.
Project PDF Code Video Poster BibTeX Best Poster (Paper) Award
Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion
Seongmin Lee, Benjamin Hoover, Hendrik Strobelt, Zijie J. Wang, ShengYun Peng, Austin Wright, Kevin Li, Haekyu Park, Haoyang Yang, Duen Horng Chau
IEEE Visualization Conference (VIS). 2023.
Project Demo PDF Code(★460) Video BibTeX
SkeleVision: Towards Adversarial Resiliency of Person Tracking with Multi-Task Learning
Nilaksh Das, ShengYun Peng, Duen Horng Chau
ECCV AROW Workshop. 2022.
Project PDF Code BibTeX
DetectorDetective: Investigating the Effects of Adversarial Examples on Object Detectors
Sivapriya Vellaichamy, Matthew Hull, Zijie J. Wang, Nilaksh Das, ShengYun Peng, Haekyu Park, Duen Horng Chau
CVPR Demo. 2022.
Project PDF BibTeX
A novel DNN tracking algorithm for structural system identification
ShengYun Peng, LingFeng Yan, Bin He, Ying Zhou
Smart Structures and Systems. 2021.
Project PDF Video BibTeX DOI
DSiamMFT: An RGB-T fusion tracking method via dynamic Siamese networks using multi-layer feature fusion
Xingchen Zhang, Ping Ye, ShengYun Peng, Jun Liu, Gang Xiao
Signal Processing, Image Communication. 2020.
Project PDF BibTeX DOI
Anti-occlusion object tracking based on correlation filter
Jun Liu, Gang Xiao, Xingchen Zhang, Ping Ye, Xingzhong Xiong, ShengYun Peng
Signal, Image and Video Processing. 2019.
Project PDF BibTeX DOI
SiamFT: An RGB-Infrared Fusion Tracking Method via Fully Convolutional Siamese Networks
Xingchen Zhang, Ping Ye, ShengYun Peng, Jun Liu, Ke Gong, Gang Xiao
IEEE Access. 2019.
Project PDF BibTeX DOI
Object Fusion Tracking Based on Visible and Infrared Images Using Fully Convolutional Siamese Networks
Xingchen Zhang, Ping Ye, Dan Qiao, Junhao Zhao, ShengYun Peng, Gang Xiao
22th International Conference on Information Fusion (FUSION). 2019.
Project PDF BibTeX DOI

Teaching

Graduate Teaching Assistant
Georgia Institute of Technology, Atlanta, GA
Data and Visual Analytics (CSE 6242), Instructor: Duen Horng Chau & Mahdi Roozbahani
Organized project teams, graded projects, and held weekly office hours for an online graduate course with 1k+ students enrolled.

Grants and Funding

Attack and Defense on Object Detector
Co-authored research proposal from Technology Innovation Institute (TII)
Document Understanding
Co-authored research proposal from Automatic Data Processing (ADP), Inc.

Talks

Safety Alignment of Generative Foundation Models
Georgia Tech Thesis Proposal
IBM Research
Ploutos AI
Microsoft Research
Capital One Research
Tesla AI
Georgia Tech HotCSE Event
UniTable: Towards a Unified Table Foundation Model
ADP AI Community of Practice Meetup
Self-supervised Pre-training for Table Structure Recognition Transformer
AAAI 2024 Scientific Document Understanding Workshop
High-Performance Transformers for Table Structure Recognition Need Early Convolutions
NeurIPS 2023 2nd Table Representation Workshop
Robust Principles
DARPA GARD PI Meeting (Evaluation 7)
Exploration of Robust Model Architectures
DARPA GARD PI Meeting (Evaluation 6)
In Search of Robust Architectures against Adversarial Attacks
Intel Labs (Internship Report)
A New Siamese-based Tracking for Structural Health Monitoring
International Workshop on Data Science in Civil Engineering

Service

Program Commitee
SIAM International Conference on Data Mining (SDM) 2024
Reviewer
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2026
Annual Meeting of the Association for Computational Linguistics (ACL) 2025
International Conference on Artificial Intelligence and Statistics (AISTATS) 2025 · 2026
International Conference on Machine Learning (ICML) 2025 · 2026
International Conference on Learning Representations (ICLR) 2025 · 2026
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) 2025 · 2026
Neural Information Processing Systems (NeurIPS) 2024 · 2025 · 2026
IEEE Transactions on Image Processing (TIP) 2025
Multimedia Systems 2025
Scientific Reports 2023
ICCV Workshop 2023
IEEE Transactions on Cybernetics 2023
ICML Workshop 2023
Signal Processing: Image Communication 2022
SN Applied Sciences 2022
Pattern Recognition 2020
IEEE Access 2020

Mentoring

Tsung-Huan Yang
MS in Computer Science, Georgia Institute of Technology
Mansi Phute
MS in Computer Science, Georgia Institute of Technology
Now: CS PhD at Georgia Institute of Technology
Kevin Li
BS in Computer Science, Georgia Institute of Technology
Now: ML PhD at Carnegie Mellon University
Chakravarthy RVK
M.S. in Analytics - Data Science, Georgia Institute of Technology
Sivapriya Vellaichamy
M.S. in Computational Data Analytics, Georgia Institute of Technology
Now: AI Research Tech - Senior Associate at JPMorgan Chase