My research interest is to develop novel algorithms that improve the trustworthiness, robustness,
and data efficiency for multimodal deep learning models. More recently, I have been focusing on
enhancing fairness, hallucinations reduction and reasoning capabilities for large language models
(LLMs) and large vision-language models (LVLMs). At Meta AI, I also work on continued-pretraining
and finetuning Llama as the next-gen recommender backbone.
From Uncertainty to Trust: Enhancing Reliability in Vision-Language Models with Uncertainty-Guided Selective Decoding
Yixiong Fang,
Ziran Yang,
Zhaorun Chen,
Zhuokai Zhao†, and
Jiawei Zhou†
In submission, 2024
Direct Acquisition Optimization for Low-Budget Active Learning
Zhuokai Zhao,
Yibo Jiang, and
Yuxin Chen
38th NeurIPS Workshop on Bayesian Decision-making and Uncertainty (Spotlight Talk), 2024
Evaluating Machine Learning Models with NERO: Non-Equivariance Revealed on Orbits
38th NeurIPS Workshop on Interpretable AI, 2024
Beyond Training: Dynamic Token Merging for Zero-Shot Video Understanding
Yiming Zhang,
Zhuokai Zhao,
Zhaorun Chen, Zenghui Ding, Xianjun Yang, and Yining Sun
In submission, 2024
EscIRL: Evolving Self-Contrastive IRL for Trajectory Prediction in Autonomous Driving
Siyue Wang*,
Zhaorun Chen*,
Zhuokai Zhao, Chaoli Mao,
Yiyang Zhou, Jiayu He, and Albert Sibo Hu
8th Annual Conference on Robot Learning (CoRL), 2024
Preference Optimization with Multi-Sample Comparisons
In submission, 2024
Quantifying Generalization Complexity for Large Language Models
In submission, 2024
Multimodal Guidance Network for Missing-Modality Inference in Content Moderation
Zhuokai Zhao, Harish Palani, Tianyi Liu, Lena Evans, and Ruth Toner
IEEE International Conference on Multimedia and Expo (ICME), 2024
MJ-BENCH: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?
Zhaorun Chen*, Yichao Du*, Zichen Wen*, Yiyang Zhou*, Chenhang Cui, Zhenzhen Weng, Haoqin Tu,
Chaoqi Wang, Zhengwei Tong, Qinglan Huang, Canyu Chen, Qinghao Ye, Zhihong Zhu, Yuqing Zhang, Jiawei Zhou,
Zhuokai Zhao, Rafael Rafailov, Chelsea Finn, and Huaxiu Yao
41st ICML Workshop on Foundation Models in the Wild, 2024
RankCLIP: Ranking-Consistent Language-Image Pretraining
Yiming Zhang*,
Zhuokai Zhao*,
Zhaorun Chen,
Zhili Feng, Zenghui Ding, and Yining Sun
In submission, 2024
PANDORA: Detailed LLM Jailbreaking via Collaborated Phishing Agents with Decomposed Reasoning
12th ICLR Workshop on Secure and Trustworthy Large Language Models, 2024
Safe Reinforcement Learning via Hierarchical Adaptive Chance-Constraint Safeguards
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding
41st International Conference on Machine Learning (ICML), 2024
Preliminary version appeared in 12th ICLR Workshop on Reliable and Responsible Foundation Models, 2024
AutoPRM: Automating Procedural Supervision for Multi-Step Reasoning via Controllable Question Decomposition
Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2024
Preliminary version appeared in ICLR Workshop on Reliable and Responsible Foundation Models, 2024
RELAX: Reinforcement Learning Enabled 2D-LiDAR Autonomous System for Parsimonious UAVs
Guanlin Wu,
Zhuokai Zhao, and
Yutao He
39th AAAI Workshop on Planning and Reinforcement Learning (PRL), 2023
Breaking the Curse of Quality Saturation with User-Centric Ranking
29th Conference on Knowledge Discovery and Data Mining (KDD), 2023
System and Method for Assisted Patient Positioning
U.S. Patent No. 10,783,655, 2020
Early Feasibility Studies of Augmented Reality Navigation for Lateral Skull Base Surgery
Otology & Neurotology 41(7):p 883-888, 2020
Enhanced Data Utilization for Efficient and Trustworthy Deep Learning
Zhuokai Zhao
Ph.D. in Computer Science, 2024
Utilizing Both Past and Future: Multi-Frame Memory Based Network in Solving Particle Image Velocimetry
Zhuokai Zhao
MS in Computer Science, 2021
OpenChemistry/Stempy: Stable Version
Zenodo, 2024
Trajectory Planning and Control for Nonholonomic Robot Among Onstacles
Nonlinear Control and Planning in Robotics, 2018
Head-Mounted Display Integration for Orthopedic Surgery
Advanced Computer-Integrated Surgery, 2017