About Me

I am a 4th year Computer Science PhD student at UIUC advised by Lingming Zhang. My research interest lies in the intersection of Machine Learning and Software Engineering. In my PhD study, I am supported by the Amazon Science Ph.D. Fellowship.

Before coming to UIUC, I completed my undergrad at the University of Toronto where I was fortunate to work with Natalie Enright Jerger, David Lie, Nicolas Papernot, and Shurui Zhou.

Selected Publications

• Agentless 😺: Demystifying LLM-based Software Engineering Agents
  Chunqiu Steven Xia*, Yinlin Deng*, Soren Dunn, Lingming Zhang | July, 2024.
  [ preprint | code]
• Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM In Proceedings of the 1st Conference on Language Modeling (COLM 2024)
  Chunqiu Steven Xia*, Yinlin Deng*, Lingming Zhang | March, 2024.
  🏆 Selected as an oral spotlight
  [ preprint | webpage | code]
• Fuzz4All: Universal Fuzzing with Large Language Models In Proceedings of the 46th IEEE/ACM International Conference on Software Engineering (ICSE 2024)
  Chunqiu Steven Xia, Matteo Paltenghi, Jia Le Tian, Michael Pradel, Lingming Zhang | April, 2024.
  [ preprint | webpage ]
• Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation In Proceedings of the 37th Annual Conference on Neural Information Processing Systems (NeurIPS 2023)
  Jiawei Liu*, Chunqiu Steven Xia*, Yuyao Wang, Lingming Zhang | Dec, 2023.
  [ preprint | code ]
• Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT In Proceedings of the 33rd International Symposium on Software Testing and Analysis (ISSTA 2024)
  Chunqiu Steven Xia and Lingming Zhang | April, 2023.
  [ preprint ]
• Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models In Proceedings of the 32nd International Symposium on Software Testing and Analysis (ISSTA 2023)
  Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, Lingming Zhang | July, 2023.
  [ preprint ]
• Automated Program Repair in the Era of Large Pre-trained Language Models In Proceedings of the 45th IEEE/ACM International Conference on Software Engineering (ICSE 2023)
  Chunqiu Steven Xia, Yuxiang Wei, Lingming Zhang | May, 2023.
  [ preprint | code ]
• Less Training, More Repairing Please: Revisiting Automated Program Repair via Zero-shot Learning In Proceedings of 30th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE 2022)
  Chunqiu Steven Xia and Lingming Zhang | Nov, 2022.
  [ paper | code ]

Invited Talks

• South Park Commons AI Agent Speaker Series: Agentless 😺: Demystifying LLM-based Software Engineering Agents
• Alibaba Tongyi Lab: Agents & LLMs for Software Development
• SecurityFrontiers.AI: Universal Fuzzing with Large Language Models
• GAI4SE @ NC State University: LLMs for Program Repair, Fuzzing and Testing
• Kwai Inc: Universal Fuzzing with Large Language Models
• Computer Security Group @ Ohio State University: Are Large Language Models Effective Fuzzers?
• Uber Programming Systems Team: Leveraging Large Language Models for Automated Program Repair ... and other Software Engineering tasks
• Microsoft Data&AI: Leveraging Large Language Models for Software Engineering Tasks
• Software Lab @ University of Stuttgart: Automated Program Repair in the era of Large Language Models

Services

• Program Committee: APR@ICSE-2024
• Reviewer: TOSEM-2023

website template shamelessly taken from Deian Stefan

Publications

Below is the list of my complete publications. Google Scholar also provides such list

• Agentless 😺: Demystifying LLM-based Software Engineering Agents
  Chunqiu Steven Xia*, Yinlin Deng*, Soren Dunn, Lingming Zhang | July, 2024.
  [ preprint | code]
• Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM In Proceedings of the 1st Conference on Language Modeling (COLM 2024)
  Chunqiu Steven Xia*, Yinlin Deng*, Lingming Zhang | March, 2024.
  [ preprint | webpage | code]
• Fuzz4All: Universal Fuzzing with Large Language Models In Proceedings of the 46th IEEE/ACM International Conference on Software Engineering (ICSE 2024)
  Chunqiu Steven Xia, Matteo Paltenghi, Jia Le Tian, Michael Pradel, Lingming Zhang | April, 2024.
  [ preprint | webpage ]
• Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair In Proceedings of the 31th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE 2023)
  Yuxiang Wei, Chunqiu Steven Xia, Lingming Zhang | Dec, 2023.
  [ preprint | code ]
• Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation In Proceedings of the 37th Annual Conference on Neural Information Processing Systems (NeurIPS 2023)
  Jiawei Liu*, Chunqiu Steven Xia*, Yuyao Wang, Lingming Zhang | Dec, 2023.
  [ preprint | code ]
• Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT In Proceedings of the 33rd International Symposium on Software Testing and Analysis (ISSTA 2024)
  Chunqiu Steven Xia and Lingming Zhang | April, 2023.
  [ preprint ]
• Large Language Models are Edge-Case Fuzzers: Testing Deep Learning Libraries via FuzzGPT In Proceedings of the 46th IEEE/ACM International Conference on Software Engineering (ICSE 2024)
  Yinlin Deng, Chunqiu Steven Xia, Chenyuan Yang, Shizhuo Dylan Zhang, Shujing Yang, Lingming Zhang | April, 2024.
  [ preprint ]
• The Plastic Surgery Hypothesis in the Era of Large Language Models In Proceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023)
  Chunqiu Steven Xia, Yifeng Ding, Lingming Zhang | Sep, 2023.
  [ preprint | code ]
• Conversational Automated Program Repair
  Chunqiu Steven Xia and Lingming Zhang | Jan, 2023.
  [ preprint ]
• Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models In Proceedings of the 32nd International Symposium on Software Testing and Analysis (ISSTA 2023)
  Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, Lingming Zhang | July, 2023.
  [ preprint ]
• Automated Program Repair in the Era of Large Pre-trained Language Models In Proceedings of the 45th IEEE/ACM International Conference on Software Engineering (ICSE 2023)
  Chunqiu Steven Xia, Yuxiang Wei, Lingming Zhang | May, 2023.
  [ preprint | code ]
• Balancing Effectiveness and Flakiness of Non-Deterministic Machine Learning Tests In Proceedings of the 45th IEEE/ACM International Conference on Software Engineering (ICSE 2023)
  Chunqiu Steven Xia, Saikat Dutta, Sasa Misailovic, Darko Marinov, Lingming Zhang | May, 2023.
  [ paper | code ]
• Less Training, More Repairing Please: Revisiting Automated Program Repair via Zero-shot Learning In Proceedings of the 30th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE 2022)
  Chunqiu Steven Xia and Lingming Zhang | Nov, 2022.
  [ paper | code ]
• A Large Scale Study of User Behavior, Expectations and Engagement with Android Permissions In Proceedings of the 30th USENIX Security Symposium (USENIX 2021)
  Weicheng Cao, Chunqiu Steven Xia, Sai Teja Peddinti, David Lie, Nina Taft, Lisa M. Austin | Aug, 2021.
  [ paper ]
• The eh model: Early design space exploration of intermittent processor architectures In Proceedings of the 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 2018)
  Joshua San Miguel, Karthik Ganesan, Mario Badr, Chunqiu Steven Xia, Rose Li, Hsuan Hsiao, Natalie Enright Jerger | Oct, 2018.
  [ paper ]