ICLR event page header - abstract shapes on a purple gradient background

October 7, 2025 – October 10, 2025

Microsoft at COLM 2025

Location: Montréal, Canada

Publications

View by:

- Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts
  
  Samin Yeasar Arnob, Zhan Su, Minseon Kim, Oleksiy Ostapenko, Riyasat Ohib, Esra'a Saleh, Doina Precup, Lucas Caccia, Alessandro Sordoni
  
  COLM 2025 | July 2025
  
  Publication
- Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale
  
  Bowen Jiang, Zhuoqun Hao, Young-Min Cho, Bryan Li, Yuan Yuan, Sihao Chen, Lyle Ungar, C. J. Taylor, Dan Roth
  
  COLM 2025 | July 2025
  
  Publication
- Putting the Value Back in RL: Better Test-Time Scaling by Unifying LLM Reasoners With Verifiers
  
  Kusha Sareen, Morgane M Moss, Alessandro Sordoni, Rishabh Agarwal, Arian Hosseini
  
  COLM 2025 | July 2025
  
  Publication
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
  
  Zefan Cai, Yichi Zhang, Bofei Gao, Yuliang Liu, Tianyu Liu, Keming Lu, Wayne Xiong, Yue Dong, Baobao Chang, Junjie Hu, Wen Xiao
  
  COLM 2025 | July 2025
  
  Publication
- Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
  
  Minseon Kim, Jin Myung Kwak, Lama Alssum, Bernard Ghanem, Philip H. S. Torr, David Krueger, Fazl Barez, Adel Bibi
  
  COLM 2025 | July 2025
  
  Publication
- Scaling Laws of Synthetic Data for Language Models
  
  Zeyu Qin, Qingxiu Dong, Xingxing Zhang, Li Dong, Xiaolong Huang, Ziyi Yang, Mahmoud Khademi, Dongdong Zhang, Hany Hassan Awadalla, Yi R. Fung, Weizhu Chen, Minhao Cheng, Furu Wei
  
  COLM 2025 | July 2025
  
  Publication
- SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compression
  
  Yucheng Li, Surin Ahn, Huiqiang Jiang, Amir H. Abdi, Yuqing Yang, Lili Qiu
  
  COLM 2025 | July 2025
  
  Publication
- SlimMoE: Structured Compression of Large MoE Models via Expert Slimming and Distillation
  
  Zichong Li, Chen Liang, Zixuan Zhang, Ilgee Hong, Young Jin Kim, Weizhu Chen, Tuo Zhao
  
  COLM 2025 | July 2025
  
  Publication
- Training Plug-and-Play Knowledge Modules with Deep Context Distillation
  
  Lucas Caccia, Alan Ansell, E. Ponti, Ivan Vuli'c, Alessandro Sordoni
  
  COLM 2025 | July 2025
  
  Publication
- REFA: Reference Free Alignment for multi-preference optimization
  
  Taneesh Gupta, Rahul Madhavan, Xuchao Zhang, Chetan Bansal, Saravan Rajmohan
  
  COLM 2025 | July 2025
  
  Publication

- Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale
  
  Bowen Jiang, Zhuoqun Hao, Young-Min Cho, Bryan Li, Yuan Yuan, Sihao Chen, Lyle Ungar, C. J. Taylor, Dan Roth
  
  COLM 2025 | July 2025
  
  Publication
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
  
  Zefan Cai, Yichi Zhang, Bofei Gao, Yuliang Liu, Tianyu Liu, Keming Lu, Wayne Xiong, Yue Dong, Baobao Chang, Junjie Hu, Wen Xiao
  
  COLM 2025 | July 2025
  
  Publication
- SlimMoE: Structured Compression of Large MoE Models via Expert Slimming and Distillation
  
  Zichong Li, Chen Liang, Zixuan Zhang, Ilgee Hong, Young Jin Kim, Weizhu Chen, Tuo Zhao
  
  COLM 2025 | July 2025
  
  Publication
- Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
  
  Minseon Kim, Jin Myung Kwak, Lama Alssum, Bernard Ghanem, Philip H. S. Torr, David Krueger, Fazl Barez, Adel Bibi
  
  COLM 2025 | July 2025
  
  Publication
- Training Plug-and-Play Knowledge Modules with Deep Context Distillation
  
  Lucas Caccia, Alan Ansell, E. Ponti, Ivan Vuli'c, Alessandro Sordoni
  
  COLM 2025 | July 2025
  
  Publication
- Putting the Value Back in RL: Better Test-Time Scaling by Unifying LLM Reasoners With Verifiers
  
  Kusha Sareen, Morgane M Moss, Alessandro Sordoni, Rishabh Agarwal, Arian Hosseini
  
  COLM 2025 | July 2025
  
  Publication
- Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts
  
  Samin Yeasar Arnob, Zhan Su, Minseon Kim, Oleksiy Ostapenko, Riyasat Ohib, Esra'a Saleh, Doina Precup, Lucas Caccia, Alessandro Sordoni
  
  COLM 2025 | July 2025
  
  Publication
- SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compression
  
  Yucheng Li, Surin Ahn, Huiqiang Jiang, Amir H. Abdi, Yuqing Yang, Lili Qiu
  
  COLM 2025 | July 2025
  
  Publication
- REFA: Reference Free Alignment for multi-preference optimization
  
  Taneesh Gupta, Rahul Madhavan, Xuchao Zhang, Chetan Bansal, Saravan Rajmohan
  
  COLM 2025 | July 2025
  
  Publication
- Scaling Laws of Synthetic Data for Language Models
  
  Zeyu Qin, Qingxiu Dong, Xingxing Zhang, Li Dong, Xiaolong Huang, Ziyi Yang, Mahmoud Khademi, Dongdong Zhang, Hany Hassan Awadalla, Yi R. Fung, Weizhu Chen, Minhao Cheng, Furu Wei
  
  COLM 2025 | July 2025
  
  Publication
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
  
  Zefan Cai, Yichi Zhang, Bofei Gao, Yuliang Liu, Tianyu Liu, Keming Lu, Wayne Xiong, Yue Dong, Baobao Chang, Junjie Hu, Wen Xiao
  
  COLM 2025 | July 2025
  
  Publication
- Scaling Laws of Synthetic Data for Language Models
  
  Zeyu Qin, Qingxiu Dong, Xingxing Zhang, Li Dong, Xiaolong Huang, Ziyi Yang, Mahmoud Khademi, Dongdong Zhang, Hany Hassan Awadalla, Yi R. Fung, Weizhu Chen, Minhao Cheng, Furu Wei
  
  COLM 2025 | July 2025
  
  Publication
- SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compression
  
  Yucheng Li, Surin Ahn, Huiqiang Jiang, Amir H. Abdi, Yuqing Yang, Lili Qiu
  
  COLM 2025 | July 2025
  
  Publication

- Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale
  
  Bowen Jiang, Zhuoqun Hao, Young-Min Cho, Bryan Li, Yuan Yuan, Sihao Chen, Lyle Ungar, C. J. Taylor, Dan Roth
  
  COLM 2025 | July 2025
  
  Publication
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
  
  Zefan Cai, Yichi Zhang, Bofei Gao, Yuliang Liu, Tianyu Liu, Keming Lu, Wayne Xiong, Yue Dong, Baobao Chang, Junjie Hu, Wen Xiao
  
  COLM 2025 | July 2025
  
  Publication
- SlimMoE: Structured Compression of Large MoE Models via Expert Slimming and Distillation
  
  Zichong Li, Chen Liang, Zixuan Zhang, Ilgee Hong, Young Jin Kim, Weizhu Chen, Tuo Zhao
  
  COLM 2025 | July 2025
  
  Publication
- Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
  
  Minseon Kim, Jin Myung Kwak, Lama Alssum, Bernard Ghanem, Philip H. S. Torr, David Krueger, Fazl Barez, Adel Bibi
  
  COLM 2025 | July 2025
  
  Publication
- Training Plug-and-Play Knowledge Modules with Deep Context Distillation
  
  Lucas Caccia, Alan Ansell, E. Ponti, Ivan Vuli'c, Alessandro Sordoni
  
  COLM 2025 | July 2025
  
  Publication
- Putting the Value Back in RL: Better Test-Time Scaling by Unifying LLM Reasoners With Verifiers
  
  Kusha Sareen, Morgane M Moss, Alessandro Sordoni, Rishabh Agarwal, Arian Hosseini
  
  COLM 2025 | July 2025
  
  Publication
- Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts
  
  Samin Yeasar Arnob, Zhan Su, Minseon Kim, Oleksiy Ostapenko, Riyasat Ohib, Esra'a Saleh, Doina Precup, Lucas Caccia, Alessandro Sordoni
  
  COLM 2025 | July 2025
  
  Publication
- SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compression
  
  Yucheng Li, Surin Ahn, Huiqiang Jiang, Amir H. Abdi, Yuqing Yang, Lili Qiu
  
  COLM 2025 | July 2025
  
  Publication
- REFA: Reference Free Alignment for multi-preference optimization
  
  Taneesh Gupta, Rahul Madhavan, Xuchao Zhang, Chetan Bansal, Saravan Rajmohan
  
  COLM 2025 | July 2025
  
  Publication
- Scaling Laws of Synthetic Data for Language Models
  
  Zeyu Qin, Qingxiu Dong, Xingxing Zhang, Li Dong, Xiaolong Huang, Ziyi Yang, Mahmoud Khademi, Dongdong Zhang, Hany Hassan Awadalla, Yi R. Fung, Weizhu Chen, Minhao Cheng, Furu Wei
  
  COLM 2025 | July 2025
  
  Publication