Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training
Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
ACL | August 2025
Qi Chen
Chercheur principal
Papiers de Collaboration
-
-
-
DistributedANN: Efficient Scaling of a Single DiskANN Graph Across Thousands of Computers
Philip Adams, Menghao Li, Shi Zhang, Li Tan, Mingqin Li, Qi Chen, Knut Magne Risvik, Jason (Zengzhong) Li, Harsha Simhadri
The 1st Workshop on Vector Databases at the 2025 International Conference on Machine Learning | July 2025
-
RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference
Yaoqi Chen, Jinkai Zhang, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang
June 2025
-
Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Qi Chen, Peng Cheng
AAAI Conference on Artificial Intelligence, 2025 | April 2025
Oral Presentation
-
Integrative Decoding: Improve Factuality via Implicit Self-consistency
Yi Cheng, Xiao Liang, Yeyun Gong, Wen Xiao, Song Wang, Yuji Zhang, Wenjun Hou, Kaishuai Xu, Wenge Liu, Wenjie Li, Jian Jiao, Qi Chen, Peng Cheng, Wayne Xiong
ICLR 2025 | January 2025
-
EpiCoder: Encompassing Diversity and Complexity in Code Generation
Yaoxiang Wang, Haoling Li, Xin Zhang, Jie Wu, Xiao Liu, Wenxiang Hu, Zhongxin Guo, Yangyu Huang, Ying Xin, Yujiu Yang, Jinsong Su, Qi Chen, Scarlett Li
ICML 2025 | January 2025
-
-
-
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
-
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
ENLSP NeurIPS Workshop 2024 | September 2024
Best Paper Award
-
Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
Mingzhe Xing, Rongkai Zhang, Hui Xue, Qi Chen, Fan Yang, Zhen Xiao
SIGKDD'24 | August 2024
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
-
-
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://clients1.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://clients1.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
Model-enhanced Vector Index
Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
NeurIPS 2023 | October 2023
-
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
-
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
-
-
-
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
-
Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings
Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie
SIGIR 2022 | April 2022
-
-
-
GLOW: Global Weighted Self-Attention Network for Web Search
Xuan Shan, Chuanjie Liu, Yiqian Xia, Qi Chen, Yusi Zhang, Kaize Ding, Yaobo Liang, Angen Luo, Yuxiang Luo
2021 INTERNATIONAL CONFERENCE ON BIG DATA | November 2021
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
-
-
Byzantine Ordered Consensus without Byzantine Oligarchy
Yunhao Zhang, Srinath Setty, Qi Chen, Lidong Zhou, Lorenzo Alvisi
Operating Systems Design and Implementation (OSDI) | October 2020
Jay Lepreau Best Paper Award
-
Estimating Minimum Operation Steps via Memory-based Recurrent Calculation Network
Lei Sha, Chen Shi, Qi Chen, Lintao Zhang, Houfeng Wang
2020 International Joint Conference on Neural Network | July 2020
-
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
-
-
-
Collaborative Learning between Cloud and End Devices: An Empirical Study on Location Prediction
Yan Lu, Yuanchao Shu, Xu Tan, Yunxin Liu, Mengyu Zhou, Qi Chen, Dan Pei
ACM/IEEE Symposium on Edge Computing | November 2019
-
We Know What You Will Ask: A Dialogue System for Multi-intent Switch and Prediction
Chen Shi, Qi Chen, Lei Sha, Hui Xue, Sujian Li, Lintao Zhang (lintaoz), Houfeng Wang
2019 International conference natural language processing | October 2019
-
-
-
Fast Clustering with Flexible Balance Constraints
Hongfu Liu, Ziming Huang, Qi Chen, Mingqin Li, Yun Fu, Lintao Zhang
2018 International Conference on Big Data | December 2018
-
Auto-Dialabel: Labeling Dialogue Data with Unsupervised Learning
Chen Shi, Qi Chen, Lei Shan, Sujian Li, Xu Sun, Houfeng Wang, Lintao Zhang
2018 Conference on Empirical Methods in Natural Language Processing | November 2018
-
-
-
Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training
Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
ACL | August 2025
-
RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference
Yaoqi Chen, Jinkai Zhang, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang
June 2025
-
Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Qi Chen, Peng Cheng
AAAI Conference on Artificial Intelligence, 2025 | April 2025
Oral Presentation
-
Integrative Decoding: Improve Factuality via Implicit Self-consistency
Yi Cheng, Xiao Liang, Yeyun Gong, Wen Xiao, Song Wang, Yuji Zhang, Wenjun Hou, Kaishuai Xu, Wenge Liu, Wenjie Li, Jian Jiao, Qi Chen, Peng Cheng, Wayne Xiong
ICLR 2025 | January 2025
-
EpiCoder: Encompassing Diversity and Complexity in Code Generation
Yaoxiang Wang, Haoling Li, Xin Zhang, Jie Wu, Xiao Liu, Wenxiang Hu, Zhongxin Guo, Yangyu Huang, Ying Xin, Yujiu Yang, Jinsong Su, Qi Chen, Scarlett Li
ICML 2025 | January 2025
-
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
-
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
ENLSP NeurIPS Workshop 2024 | September 2024
Best Paper Award
-
Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
Mingzhe Xing, Rongkai Zhang, Hui Xue, Qi Chen, Fan Yang, Zhen Xiao
SIGKDD'24 | August 2024
-
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
-
Model-enhanced Vector Index
Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
NeurIPS 2023 | October 2023
-
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
-
Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings
Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie
SIGIR 2022 | April 2022
-
Collaborative Learning between Cloud and End Devices: An Empirical Study on Location Prediction
Yan Lu, Yuanchao Shu, Xu Tan, Yunxin Liu, Mengyu Zhou, Qi Chen, Dan Pei
ACM/IEEE Symposium on Edge Computing | November 2019
-
Auto-Dialabel: Labeling Dialogue Data with Unsupervised Learning
Chen Shi, Qi Chen, Lei Shan, Sujian Li, Xu Sun, Houfeng Wang, Lintao Zhang
2018 Conference on Empirical Methods in Natural Language Processing | November 2018
-
-
-
DistributedANN: Efficient Scaling of a Single DiskANN Graph Across Thousands of Computers
Philip Adams, Menghao Li, Shi Zhang, Li Tan, Mingqin Li, Qi Chen, Knut Magne Risvik, Jason (Zengzhong) Li, Harsha Simhadri
The 1st Workshop on Vector Databases at the 2025 International Conference on Machine Learning | July 2025
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
Model-enhanced Vector Index
Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
NeurIPS 2023 | October 2023
-
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
-
GLOW: Global Weighted Self-Attention Network for Web Search
Xuan Shan, Chuanjie Liu, Yiqian Xia, Qi Chen, Yusi Zhang, Kaize Ding, Yaobo Liang, Angen Luo, Yuxiang Luo
2021 INTERNATIONAL CONFERENCE ON BIG DATA | November 2021
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
-
-
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
ENLSP NeurIPS Workshop 2024 | September 2024
Best Paper Award
-
-
-
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
ENLSP NeurIPS Workshop 2024 | September 2024
Best Paper Award
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://clients1.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://clients1.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
-
GLOW: Global Weighted Self-Attention Network for Web Search
Xuan Shan, Chuanjie Liu, Yiqian Xia, Qi Chen, Yusi Zhang, Kaize Ding, Yaobo Liang, Angen Luo, Yuxiang Luo
2021 INTERNATIONAL CONFERENCE ON BIG DATA | November 2021
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
Byzantine Ordered Consensus without Byzantine Oligarchy
Yunhao Zhang, Srinath Setty, Qi Chen, Lidong Zhou, Lorenzo Alvisi
Operating Systems Design and Implementation (OSDI) | October 2020
Jay Lepreau Best Paper Award
-
Estimating Minimum Operation Steps via Memory-based Recurrent Calculation Network
Lei Sha, Chen Shi, Qi Chen, Lintao Zhang, Houfeng Wang
2020 International Joint Conference on Neural Network | July 2020
-
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
-
Collaborative Learning between Cloud and End Devices: An Empirical Study on Location Prediction
Yan Lu, Yuanchao Shu, Xu Tan, Yunxin Liu, Mengyu Zhou, Qi Chen, Dan Pei
ACM/IEEE Symposium on Edge Computing | November 2019
-
We Know What You Will Ask: A Dialogue System for Multi-intent Switch and Prediction
Chen Shi, Qi Chen, Lei Sha, Hui Xue, Sujian Li, Lintao Zhang (lintaoz), Houfeng Wang
2019 International conference natural language processing | October 2019
-
Fast Clustering with Flexible Balance Constraints
Hongfu Liu, Ziming Huang, Qi Chen, Mingqin Li, Yun Fu, Lintao Zhang
2018 International Conference on Big Data | December 2018
-
-
-
Byzantine Ordered Consensus without Byzantine Oligarchy
Yunhao Zhang, Srinath Setty, Qi Chen, Lidong Zhou, Lorenzo Alvisi
Operating Systems Design and Implementation (OSDI) | October 2020
Jay Lepreau Best Paper Award
-
-
-
RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference
Yaoqi Chen, Jinkai Zhang, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang
June 2025
-
-
-
Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training
Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
ACL | August 2025
-
DistributedANN: Efficient Scaling of a Single DiskANN Graph Across Thousands of Computers
Philip Adams, Menghao Li, Shi Zhang, Li Tan, Mingqin Li, Qi Chen, Knut Magne Risvik, Jason (Zengzhong) Li, Harsha Simhadri
The 1st Workshop on Vector Databases at the 2025 International Conference on Machine Learning | July 2025
-
Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Qi Chen, Peng Cheng
AAAI Conference on Artificial Intelligence, 2025 | April 2025
Oral Presentation
-
Integrative Decoding: Improve Factuality via Implicit Self-consistency
Yi Cheng, Xiao Liang, Yeyun Gong, Wen Xiao, Song Wang, Yuji Zhang, Wenjun Hou, Kaishuai Xu, Wenge Liu, Wenjie Li, Jian Jiao, Qi Chen, Peng Cheng, Wayne Xiong
ICLR 2025 | January 2025
-
EpiCoder: Encompassing Diversity and Complexity in Code Generation
Yaoxiang Wang, Haoling Li, Xin Zhang, Jie Wu, Xiao Liu, Wenxiang Hu, Zhongxin Guo, Yangyu Huang, Ying Xin, Yujiu Yang, Jinsong Su, Qi Chen, Scarlett Li
ICML 2025 | January 2025
-
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
-
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
ENLSP NeurIPS Workshop 2024 | September 2024
Best Paper Award
-
Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
Mingzhe Xing, Rongkai Zhang, Hui Xue, Qi Chen, Fan Yang, Zhen Xiao
SIGKDD'24 | August 2024
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://clients1.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://clients1.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
Model-enhanced Vector Index
Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
NeurIPS 2023 | October 2023
-
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
-
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
-
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
-
Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings
Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie
SIGIR 2022 | April 2022
-
GLOW: Global Weighted Self-Attention Network for Web Search
Xuan Shan, Chuanjie Liu, Yiqian Xia, Qi Chen, Yusi Zhang, Kaize Ding, Yaobo Liang, Angen Luo, Yuxiang Luo
2021 INTERNATIONAL CONFERENCE ON BIG DATA | November 2021
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
Byzantine Ordered Consensus without Byzantine Oligarchy
Yunhao Zhang, Srinath Setty, Qi Chen, Lidong Zhou, Lorenzo Alvisi
Operating Systems Design and Implementation (OSDI) | October 2020
Jay Lepreau Best Paper Award
-
Estimating Minimum Operation Steps via Memory-based Recurrent Calculation Network
Lei Sha, Chen Shi, Qi Chen, Lintao Zhang, Houfeng Wang
2020 International Joint Conference on Neural Network | July 2020
-
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
-
Collaborative Learning between Cloud and End Devices: An Empirical Study on Location Prediction
Yan Lu, Yuanchao Shu, Xu Tan, Yunxin Liu, Mengyu Zhou, Qi Chen, Dan Pei
ACM/IEEE Symposium on Edge Computing | November 2019
-
We Know What You Will Ask: A Dialogue System for Multi-intent Switch and Prediction
Chen Shi, Qi Chen, Lei Sha, Hui Xue, Sujian Li, Lintao Zhang (lintaoz), Houfeng Wang
2019 International conference natural language processing | October 2019
-
Fast Clustering with Flexible Balance Constraints
Hongfu Liu, Ziming Huang, Qi Chen, Mingqin Li, Yun Fu, Lintao Zhang
2018 International Conference on Big Data | December 2018
-
Auto-Dialabel: Labeling Dialogue Data with Unsupervised Learning
Chen Shi, Qi Chen, Lei Shan, Sujian Li, Xu Sun, Houfeng Wang, Lintao Zhang
2018 Conference on Empirical Methods in Natural Language Processing | November 2018
-