Selected Publications

Preprints

Towards General Computer Control: A Multimodal Agent for Red Dead Redemption II as a Case Study

Weihao Tan, Ziluo Ding, Wentao Zhang, Boyu Li, Bohan Zhou, Junpeng Yue, Haochong Xia, Jiechuan Jiang, Longtao Zheng, Xinrun Xu, Yifei Bi, Pengjie Gu, Xinrun Wang, Börje F Karlsson, Bo An, and Zongqing Lu

arXiv:2403.03186

Details PDF Project

Best Possible Q-Learning

Jiechuan Jiang and Zongqing Lu

arXiv:2302.01188

Details PDF Project

Conferences

[NAACL'24] AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback

Wanpeng Zhang and Zongqing Lu

Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Findings, June 16–21, 2024.

Details PDF Project

[NAACL'24] LLaMA Rider: Spurring Large Language Models to Explore the Open World

Yicheng Feng, Yuxuan Wang, Jiazheng Liu, Sipeng Zheng, and Zongqing Lu

Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Findings, June 16–21, 2024.

Details PDF Project

[ICLR'24] Pre-Training Goal-Based Models for Sample-Efficient Reinforcement Learning

Haoqi Yuan, Zhancun Mu, Feiyang Xie, Zongqing Lu

Eighth International Conference on Learning Representations (ICLR), May 7-11, 2024. (Acceptance Rate: 1.2%, oral)

Details PDF Project

[ICLR'24] SEABO: A Simple Search-Based Method for Offline Imitation Learning

Jiafei Lyu, Xiaoteng Ma, Le Wan, Runze Liu, Xiu Li, Zongqing Lu

Eighth International Conference on Learning Representations (ICLR), May 7-11, 2024. (Acceptance Rate: 31%)

Details PDF Project

[ICLR'24] Steve-Eye: Equipping LLM-based Embodied Agents with Visual Perception in Open Worlds

Sipeng Zheng, Jiazheng Liu, Yicheng Feng, and Zongqing Lu

Eighth International Conference on Learning Representations (ICLR), May 7-11, 2024. (Acceptance Rate: 31%)

Details PDF Project

[AAMAS'24] Multi-Agent Alternate Q-Learning

Kefan Su, Siyuan Zhou, Jiechuan Jiang, Chuang Gan, Xiangjun Wang, and Zongqing Lu

Twenty-Third International Conference on Autonomous Agents and Multiagent Systems (AAMAS), May 6-10. (Acceptance Rate: 25%=²²⁹⁄₈₈₃)

Details PDF Project

[AAAI'24] Learning Multi-Object Positional Relationships via Emergent Communication

Yicheng Feng, Boshi An, and Zongqing Lu

Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), February 20-27, 2024 (Acceptance Rate: 23.75%=²³⁴²⁄₉₈₆₂)

Details PDF Project

[AAAI'24] Settling Decentralized Multi-Agent Coordinated Exploration by Novelty Sharing

Haobin Jiang, Ziluo Ding, and Zongqing Lu

Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), February 20-27, 2024 (Acceptance Rate: 23.75%=²³⁴²⁄₉₈₆₂)

Details PDF Project

[NeurIPS'23] Learning from Visual Observation via Offline Pretrained State-to-Go Transformer

Bohan Zhou, Ke Li, Jiechuan Jiang, and Zongqing Lu

Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS), Dec. 10-16, 2023. (Acceptance Rate: 26.1%=³²²¹⁄₁₂₃₄₃)

Details PDF Project

[NeurIPS'23] Mutual-Information Regularized Multi-Agent Policy Iteration

Jiangxing Wang, Deheng Ye, and Zongqing Lu

Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS), Dec. 10-16, 2023. (Acceptance Rate: 26.1%=³²²¹⁄₁₂₃₄₃)

Details PDF Project

[ICCV'23] ReLeaPS: Reinforcement Learning-based Illumination Planning for Generalized Photometric Stereo

Junhoong Chan, Bohan Yu, Heng Guo, Jieji Ren, Zongqing Lu, and Boxin Shi

International Conference on Computer Vision (ICCV), October 2-6, 2023.

Details PDF Project

[ECAI'23] Offline Decentralized Multi-Agent Reinforcement Learning

Jiechuan Jiang and Zongqing Lu

26th European Conference on Artificial Intelligence (ECAI), Sept. 30-Oct. 4, 2023. (Acceptance Rate: 24%=³⁹¹⁄₁₆₃₁)

Details PDF Project

[ACL'23] Multi-Agent Language Learning: Symbolic Mapping

Yicheng Feng and Zongqing Lu

61st Annual Meeting of the Association for Computational Linguistics (ACL), Findings, July 9-14, 2023.

Details PDF Project

[ICML'23] Entity Divider with Language Grounding in Multi-Agent Reinforcement Learning

Ziluo Ding, Wanpeng Zhang, Junpeng Yue, Xiangjun Wang, Tiejun Huang, and Zongqing Lu

Fortieth International Conference on Machine Learning (ICML), July 23-29, 2023. (Acceptance Rate: 27.9%=¹⁸²⁷⁄₆₅₃₈)

Details PDF Project

[CVPR'23] Multi-Agent Automated Machine Learning

Zhaozhi Wang, Kefan Su, Jian Zhang, Huizhu Jia, Qixiang Ye, Xiaodong Xie, and Zongqing Lu

IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR), Jun 18-22, 2023. (Acceptance Rate: 25.78%=²³⁶⁰⁄₉₁₅₅)

Details PDF Project

[ICLR'23] State Advantage Weighting for Offline RL

Jiafei Lyu, Aicheng Gong, Le Wan, Zongqing Lu, and Xiu Li

Eleventh International Conference on Learning Representations (ICLR), Tiny Papers, May 1-5, 2023.

Details PDF Project NeurIPS’22 Workshop on Offline RL

[ICLR'23] More Centralized Training, Still Decentralized Execution: Multi-Agent Conditional Policy Factorization

Jiangxing Wang, Deheng Ye, and Zongqing Lu

Eleventh International Conference on Learning Representations (ICLR), May 1-5, 2023.

Details PDF Code Project

[AAMAS'23] Adaptive Learning Rates for Multi-Agent Reinforcement Learning

Jiechuan Jiang and Zongqing Lu

Twenty-Second International Conference on Autonomous Agents and Multiagent Systems (AAMAS), May 29 - June 2, 2023. (Acceptance Rate: 23%=²³⁷⁄₁₀₁₅)

Details PDF Project

[AAAI'23] Online Tuning for Offline Decentralized Multi-Agent Reinforcement Learning

Jiechuan Jiang and Zongqing Lu

Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), February 7-14, 2023. (Acceptance Rate: 19%=¹⁷²¹⁄₈₇₇₇)

Details PDF Project

[NIPS'22] I2Q: A Fully Decentralized Q-Learning Algorithm

Jiechuan Jiang and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁)

Details PDF Code Project

[NIPS'22] Model-Based Opponent Modeling

Xiaopeng Yu, Jiechuan Jiang, Wanpeng Zhang, Haobin Jiang, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁)

Details PDF Code Project

[NIPS'22] Mildly Conservative Q-Learning for Offline Reinforcement Learning

Jiafei Lyu, Xiaoteng Ma, Xiu Li, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁, spotlight)

Details PDF Code Project

[NIPS'22] Double Check Your State Before Trusting It: Confidence-Aware Bidirectional Offline Model-Based Imagination

Jiafei Lyu, Xiu Li, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁, spotlight)

Details PDF Project

[NIPS'22] Learning to Share in Multi-Agent Reinforcement Learning

Yuxuan Yi, Ge Li, Yaowei Wang, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁)

Details PDF Code Dataset Project Best Cooperative AI Paper Award ICLR’22 Workshop on GamificationMAS ICLR'22 Workshop on Cells2Societies (oral)

[NIPS'22] Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning

Yuanpei Chen, Tianhao Wu, Shengjie Wang, Xidong Feng, Jiechuan Jiang, Stephen Marcus McAleer, Hao Dong, Zongqing Lu, Song-Chun Zhu, and Yaodong Yang

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022.

Details PDF Code Project Datasets and Benchmarks

[ICML'22] Divergence-Regularized Multi-Agent Actor-Critic

Kefan Su and Zongqing Lu

Thirty-Ninth International Conference on Machine Learning (ICML), July 17-23, 2022 (Acceptance Rate: 22%=¹²³⁵⁄₅₆₃₀)

Details PDF Code Project

[ICML'22] Robust Task Representations for Offline Meta-Reinforcement Learning via Contrastive Learning

Haoqi Yuan and Zongqing Lu

Thirty-Ninth International Conference on Machine Learning (ICML), July 17-23, 2022 (Acceptance Rate: 22%=¹²³⁵⁄₅₆₃₀)

Details PDF Code Project

[ICML'22] Difference Advantage Estimation for Multi-Agent Policy Gradients

Yueheng Li, Guangming Xie, and Zongqing Lu

Thirty-Ninth International Conference on Machine Learning (ICML), July 17-23, 2022 (Acceptance Rate: 22%=¹²³⁵⁄₅₆₃₀)

Details PDF Project

[ICML'21] The Emergence of Individuality

Jiechuan Jiang and Zongqing Lu

Thirty-Eighth International Conference on Machine Learning (ICML), July 18-24, 2021 (Acceptance Rate: 3%=¹⁶⁶⁄₅₅₁₃, oral presentation)

Details PDF Project

[ICML'21] FOP: Factorizing Optimal Joint Policy of Maximum-Entropy Multi-Agent Reinforcement Learning

Tianhao Zhang, Yueheng Li, Chen Wang, Guangming Xie and Zongqing Lu

Thirty-Eighth International Conference on Machine Learning (ICML), July 18-24, 2021 (Acceptance Rate: 21%=¹¹⁸⁴⁄₅₅₁₃)

Details PDF Code Project

[AAAI'21] Hierarchically and Cooperatively Learning Traffic Signal Control

Bingyu Xu, Yaowei Wang, Zhaozhi Wang, Huizhu Jia, and Zongqing Lu

Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI), February 2-9, 2021. (Acceptance Rate: 21%=¹⁶⁹²⁄₇₉₁₁)

Details PDF Code Dataset Project

[DATE'21] Asynchronous Reinforcement Learning Framework for Net Order Exploration in Detailed Routing

Tong Qu, Yibo Lin, Zongqing Lu, Yajun Su, and Yayi Wei

Design, Automation and Test in Europe Conference (DATE), February 1-5, 2021.

Details PDF Project

[NIPS'20] Learning Individually Inferred Communication for Multi-Agent Cooperation

Ziluo Ding, Tiejun Huang, and Zongqing Lu

Thirty-Fourth Annual Conference on Neural Information Processing Systems (NIPS), December 6-12, 2020. (Acceptance Rate: 1%=¹⁰⁵⁄₉₄₅₄, oral)

Details PDF Code Project

[ICLR'20] Graph Convolutional Reinforcement Learning

Jiechuan Jiang, Chen Dun, Tiejun Huang and Zongqing Lu

International Conference on Learning Representation (ICLR), April 26-30, 2020. (Acceptance Rate: 26.5%=⁶⁸⁷⁄₂₅₉₄)

Details PDF Video Code Project

[AAAI'20] Generative Exploration and Exploitation

Jiechuan Jiang and Zongqing Lu

Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), February 7-12, 2020. (Acceptance Rate: 21%=¹⁵⁹¹⁄₇₇₃₇)

Details PDF Project ICML'19 Workshop on ERL (Spotlight Talk)

[NIPS'19] Learning Fairness in Multi-Agent Systems

Jiechuan Jiang and Zongqing Lu

Thirty-Third Annual Conference on Neural Information Processing Systems (NIPS), December 8-14, 2019. (Acceptance Rate: 21%=¹⁴²⁸⁄₆₇₄₃)

Details PDF Video Code Project

[BuildSys'19] Heterogeneous Transfer Learning for Thermal Comfort Modeling

Weizheng Hu, Yong Luo, Zongqing Lu, and Yonggang Wen

In Proceedings of ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys), November 13-14, 2019. (Acceptance Rate: 31%=⁴⁰⁄₁₃₁)

Details PDF Project

[NIPS'18] Learning Attentional Communication for Multi-Agent Cooperation

Jiechuan Jiang and Zongqing Lu

Thirty-Second Annual Conference on Neural Information Processing Systems (NIPS), December 3-8, 2018. (Acceptance Rate: 21%=¹⁰¹¹⁄₄₈₅₆)

Details PDF Video Project

[INFOCOM'18] A Computing Platform for Video Crowdprocessing Using Deep Learning

Zongqing Lu, Kevin Chan, and Thomas La Porta

In Proceedings of IEEE International Conference on Computer Communications (INFOCOM), April 15-19, 2018. (Acceptance Rate: 19%=³⁰⁹⁄₁₆₀₆)

Details PDF Slides Project Journal Version

[MM'17] Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices

Zongqing Lu, Swati Rallapalli, Kevin Chan, and Thomas La Porta

In Proceedings of ACM International Conference on Multimedia (MM), October 23-27, 2017. (Acceptance Rate: 28%=¹⁹¹⁄₆₇₅)

Details PDF Project Journal Version

[ICNP'16] On-demand Video Processing in Wireless Networks

Zongqing Lu, Kevin Chan, Rahul Urgaonkar, and Thomas La Porta

In Proceedings of IEEE International Conference on Network Protocols (ICNP), November 8-11, 2016. (Acceptance Rate: 20%=⁴⁶⁄₂₂₉)

Details PDF Project Journal Version

[INFOCOM'16] Cooperative Data Offloading in Opportunistic Mobile Networks

Zongqing Lu, Xiao Sun, and Thomas La Porta

In Proceedings of IEEE International Conference on Computer Communications (INFOCOM), April 10-15, 2016. (Acceptance Rate: 18%=³⁰⁰⁄₁₆₄₄)

Details PDF Slides Project Best-in-Session Presentation Award Journal Version

[PerCom'16] Networking Smartphones for Disaster Recovery

Zongqing Lu, Guohong Cao, and Thomas La Porta

In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom), March 14-18, 2016. (Acceptance Rate: 12%=²⁰⁄₁₆₈)

Details PDF Slides Project NSF Travel Grant Award Journal Version

[UbiComp'15] SymDetector: Detecting Sound-Related Respiratory Symptoms Using Smartphones

Xiao Sun, Zongqing Lu, Wenjie Hu, and Guohong Cao

In Proceedings of ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), September 7-11, 2015. (Acceptance Rate: 24%=⁹³⁄₃₉₄)

Details PDF Project

[ICCCN'15] Task Allocation for Mobile Cloud Computing in Heterogeneous Wireless Networks

Zongqing Lu, Jing Zhao, Yibo Wu, and Guohong Cao

In Proceedings of International Conference on Computer Communications and Networks (ICCCN), August 3-6, 2015. (Acceptance Rate: 25%=⁸⁸⁄₃₅₂)

Details PDF

[PerCom'15] Targeted Vaccination Based on a Wireless Sensor System

Xiao Sun, Zongqing Lu, Xiaomei Zhang, Marcel Salathe, and Guohong Cao

In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom), March 23-27, 2015. (Acceptance Rate: 15%=²⁹⁄₁₉₆)

Details PDF Project

[SECON'14] Skeleton Construction in in Mobile Social Networks: Algorithms and Applications

Zongqing Lu, Xiao Sun, Yonggang Wen, and Guohong Cao

In Proceedings of IEEE International Conference on Sensing, Communication and Networking (SECON), June 30-July 3, 2014. (Acceptance Rate: 20%=⁶⁸⁄₃₄₂)

Details PDF Project

[INFOCOM'14] Information Diffusion in Mobile Social Networks: The Speed Perspective

Zongqing Lu, Yonggang Wen, and Guohong Cao

In Proceedings of IEEE International Conference on Computer Communicaitons (INFOCOM), April 27-May 2, 2014. (Acceptance Rate: 19%=³²⁰⁄₁₆₄₅)

Details PDF Project Journal Version

[PerCom'13] Community Detection in Weighted Networks: Algorithms and Applications

Zongqing Lu, Yonggang Wen, and Guohong Cao

In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom), March 18-22, 2013. (Acceptance Rate: 15%=²⁰⁄₁₆₈)

Details PDF Project Journal Version

Journals

[TMLR] A Fully Decentralized Surrogate for Multi-Agent Policy Optimization

Kefan Su and Zongqing Lu

Transactions on Machine Learning Research (TMLR), 2024

Details PDF Code Project

[TPAMI] Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation

Yuanpei Chen, Yiran Geng, Fangwei Zhong, Jiaming Ji, Jiechuang Jiang, Zongqing Lu, Hao Dong, Yaodong Yang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

Details PDF Code Project

[TMLR] A Survey on Transformers in Reinforcement Learning

Wenzhe Li, Hao Luo, Zichuan Lin, Chongjie Zhang, Zongqing Lu, and Deheng Ye

Transactions on Machine Learning Research (TMLR), 2023.

Details PDF Project

[TKDE] MetaVIM: Meta Variationally Intrinsic Motivated Reinforcement Learning for Decentralized Traffic Signal Control

Liwen Zhu, Peixi Peng, Zongqing Lu, Yonghong Tian

IEEE Transactions on Knowledge and Data Engineering (TKDE), vol. 35, no. 11, pp 11570-11584, 2023.

Details PDF Code Dataset Project

[TCAD] Asynchronous Reinforcement Learning Framework and Knowledge Transfer for Net Order Exploration in Detailed Routing

Yibo Lin, Tong Qu, Zongqing Lu, Yajun Su, and Yayi Wei

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol 41, no. 9, pp 3132 - 3142, 2022

Details PDF Project

[TBME] Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning

Huy Phan, Oliver Chen, Philipp Koch, Zongqing Lu, Ian McLoughlin, Alfred Mertins, and Maarten De Vos

IEEE Transactions on Biomedial Engineering, vol. 68, no. 6, pp. 1787-1798, 2021.

Details PDF Project

[TMC] PicSys: Energy-Efficient Fast Image Search on Distributed Mobile Networks

Noor Felemban, Fidan Mehmeti, Hana Khamfroush, Zongqing Lu, Swati Rallapalli, Kevin Chan, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol. 20, no. 4, pp. 1574-1589, 2021.

Details PDF Project

[TMC] Augur: Modeling the Resource Requirements of ConvNets on Mobile Devices

Zongqing Lu, Swati Rallapalli, Kevin Chan, Shiliang Pu, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol. 20, no. 2, pp. 352-365, 2021

Details PDF Project

[TON] NetVision: On-demand Video Processing in Wireless Networks

Zongqing Lu, Kevin Chan, Rahul Urgaonkar, Shiliang Pu, and Thomas La Porta

IEEE/ACM Transactions on Networking, vol 28, no. 1, pp. 196-209, 2020

Details PDF Project

[TMC] CrowdVision: A Computing Platform for Video Crowdprocessing Using Deep Learning

Zongqing Lu, Kevin Chan, Shiliang Pu, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol.18, no. 7, pp. 1513-1526, 2019

Details PDF Project

[TON] Cooperative Data Offload in Opportunistic Networks: From Mobile Devices to Infrastructure

Zongqing Lu, Xiao Sun, and Thomas La Porta

IEEE/ACM Transactions on Networking, vol. 25, no. 6, pp. 3382-3395, 2017.

Details PDF Project

[TMC] TeamPhone: Networking Smartphones for Disaster Recovery

Zongqing Lu, Guohong Cao, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol. 16, no. 12, pp. 3554-3567, 2017.

Details PDF Project

[TMC] Towards Information Diffusion in Mobile Social Networks

Zongqing Lu, Yonggang Wen, Weizhan Zhang, Qinghua Zheng, and Guohong Cao

IEEE Transactions on Mobile Computing, vol. 15, no. 5, pp. 1292-1304, 2016.

Details PDF Project

[TPDS] Algorithms and Applications for Community Detection in Weighted Networks

Zongqing Lu, Xiao Sun, Yonggang Wen, Guohong Cao, and Thomas La Porta

IEEE Transactions on Parallel and Distributed Systems, vol. 26, no. 4, pp. 2916-2916, 2015.

Details PDF Project

[JSAC] Toward Efficient Distributed Algorithms for In-network Binary Operator Tree Placement in Wireless Sensor Networks

Zongqing Lu, Yonggang Wen, Fan Rui, Su-Lim Tan, and Jit Biswas

IEEE Journal on Selected Areas in Communications, vol. 31, no. 4, pp. 743-755, 2013.

Details PDF

Workshops

Skill Reinforcement Learning and Planning for Open-World Long-Horizon Tasks

Haoqi Yuan, Chi Zhang, Hongcheng Wang, Feiyang Xie, Penglin Cai, Hao Dong, Zongqing Lu

NeurIPS 2023 Workshop on Foundation Models for Decision Making.

Details PDF Code Project

MTLight: Efficient Multi-Task Reinforcement Learning for Traffic Signal Control

Liwen Zhu, Peixi Peng, Zongqing Lu, and Yonghong Tian

ICLR 2022 Workshop on Gamification and Multiagent Solutions.

Details PDF Dataset Project