Publications
- Preprints
- Large Language Model-Based Agents for Software Engineering: A Survey
Junwei Liu, Kaixin Wang, Yixuan Chen, Xin Peng, Zhenpeng Chen, Lingming Zhang, Yiling Lou
https://doi.org/10.48550/arXiv.2409.02977
- π« StarCoder 2 and The Stack v2: The Next Generation
Anton Lozhkov, Raymond Li, Loubna Ben Allal, Federico Cassano, et al.
https://doi.org/10.48550/arXiv.2402.19173
[GitHub][Hugging Face][The Stack v2]
A series of fully open-source code LLMs with over One Million downloads; pre-training strategies used by various code LLMs (including the recent Qwen2.5-Coder).
- Peer-Reviewed
- KernelGPT: Enhanced Kernel Fuzzing via Large Language Models
Chenyuan Yang, Zijie Zhao, Lingming Zhang
Proceedings of 30th International Conference on Architectural Support for Programming Languages and Operating Systems
(ASPLOS 2025), 14 pages, to appear,
March 2025. [PDF][arXiv]
- Agentlessπ±: Demystifying LLM-based Software Engineering Agents
Chunqiu Steven Xia*, Yinlin Deng*, Soren Dunn, Lingming Zhang
Proceedings of 33rd ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2025), 24 pages, to appear,
June 2025. [PDF][arXiv]
Used by OpenAI and DeepSeek as the default approach to showcase the real-world coding performance of their recent models, including GPT-4o, o1, DeepSeek-V3, and DeepSeek-R1.
- SelfCodeAlign: Self-Alignment for Code Generation
Wei, Yuxiang, Federico Cassano, Jiawei Liu, Yifeng Ding, Naman Jain, Zachary Mueller,
Harm de Vries, Leandro Von Werra, Arjun Guha, Lingming Zhang
Proceedings of the 38th Conference on Neural Information Processing Systems
(NeurIPS 2024), 15 pages, to appear, Dec. 2024. [PDF] [arXiv]
- Can LLMs Implicitly Learn Numeric Parameter Constraints in Data Science APIs?
Yinlin Deng, Chunqiu Steven Xia, Zhezhen Cao, Meiziniu Li, Lingming Zhang
Proceedings of the 38th Conference on Neural Information Processing Systems
(NeurIPS 2024), 15 pages, to appear, Dec. 2024. [PDF] [Preprint]
- Automated Program Repair via Conversation: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT
Chunqiu Steven Xia, Lingming Zhang
Proceedings of the 33rd ACM International Symposium on Software
Testing and Analysis
(ISSTA 2024), 13 pages, to appear, Sept. 2024. [PDF][arXiv]
(Initial version on arXiv since Jan 2023.)
- White-box Compiler Fuzzing Empowered by Large Language Models
Chenyuan Yang, Yinlin Deng, Runyu Lu, Jiayi Yao, Jiawei Liu, Reyhaneh Jabbarvand, Lingming Zhang
Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications
(OOPSLA 2024), 27 pages,
Oct. 2024. [PDF][arXiv]
- Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM
Chunqiu Steven Xia*, Yinlin Deng*, Lingming Zhang
Proceedings of the 1st Conference on Language Modeling
(COLM 2024), 13 pages,
Sept. 2024. [arXiv]
(π This paper is selected as an Oral Spotlight Paper, 22 from all 299 accepted papers.)
- Evaluating Language Models for Efficient Code Generation
Jiawei Liu, Songrun Xie, Junhao Wang, Yuxiang Wei, Yifeng Ding, Lingming Zhang
Proceedings of the 1st Conference on Language Modeling
(COLM 2024), 13 pages,
Sept. 2024. [arXiv]
- π© Magicoder: Empowering Code Generation with OSS-Instruct
Yuxiang Wei, Zhe Wang, Jiawei Liu, Yifeng Ding, Lingming Zhang
Proceedings of the 41st International Conference on Machine Learning
(ICML 2024), to appear,
July 2024. [arXiv][Hugging Face]
OSS-Instruct has been adopted by various recent LLMs, including Meta Llama 3, Alibaba Qwen2.5-Coder, Google CodeGemma, IBM Granite, and Snowflake SnowCoder.
- xFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
Yifeng Ding, Jiawei Liu, Yuxiang Wei, Terry Yue Zhuo, Lingming Zhang
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics
(ACL 2024), to appear,
August 2024. [arXiv]
- Universal Fuzzing via Large Language Models
Chunqiu Steven Xia, Matteo Paltenghi, Jia Le Tian, Michael Pradel, Lingming Zhang
Proceedings of the 46th IEEE/ACM International Conference on Software Engineering
(ICSE 2024), 13 pages, to appear,
April 2024. [PDF][arXiv]
- Large Language Models are Edge-Case Generators: Crafting Unusual Programs for Fuzzing Deep Learning Libraries
Yinlin Deng, Chunqiu Steven Xia, Chenyuan Yang, Shizhuo Dylan Zhang, Shujing Yang, Lingming Zhang
Proceedings of the 46th IEEE/ACM International Conference on Software Engineering
(ICSE 2024), 13 pages, to appear,
April 2024. [PDF][arXiv]
- Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation
Jiawei liu*, Chunqiu Steven Xia*, Yuyao Wang, Lingming Zhang
Proceedings of the 37th Conference on Neural Information Processing Systems
(NeurIPS 2023), 15 pages, to appear, Dec. 2023. [PDF]
[arXiv][GitHub][Hugging Face][Leaderboard]
- NeuRI: Diversifying DNN Generation via Inductive Rule Inference
Jiawei Liu, Jinjun Peng, Yuyao Wang, Lingming Zhang
Proceedings of 31st ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2023), 13 pages, to appear,
Dec. 2023. [PDF][arXiv]
(π This paper won an ACM SIGSOFT Distinguished Paper Award.)
- Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair
Yuxiang Wei, Chunqiu Steven Xia, Lingming Zhang
Proceedings of 31st ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2023), 13 pages, to appear,
Dec. 2023. [PDF][arXiv]
(π This paper has been selected as CACM Research Highlights)
- A Large-scale Empirical Review of Patch Correctness Checking Approaches
Jun Yang*, Yuehan Wang*, Yiling Lou, Ming Wen, Lingming Zhang
Proceedings of 31st ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2023), 13 pages, to appear,
Dec. 2023. [PDF][arXiv]
- The Plastic Surgery Hypothesis in the Era of Large Language Models
Chunqiu Steven Xia, Yifeng Ding, Lingming Zhang
Proceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering
(ASE 2023),13 pages, to appear, Sept. 2023.
[PDF]
[arXiv]
- Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models
Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, Lingming Zhang
Proceedings of the 32nd ACM International Symposium on Software
Testing and Analysis
(ISSTA 2023), 13 pages, to appear, July 2023. [PDF][arXiv]
- Vectorizing Program Ingredients for Better JVM Testing
Tianchang Gao, Junjie Chen, Yingquan Zhao, Yuqun Zhang, Lingming Zhang
Proceedings of the 32nd ACM International Symposium on Software
Testing and Analysis
(ISSTA 2023), 13 pages, to appear, July 2023. [PDF]
- Automated Program Repair in the Era of Large Pre-trained Language Models
Chunqiu Steven Xia, Yuxiang Wei, Lingming Zhang
Proceedings of the 45th IEEE/ACM International Conference on Software Engineering
(ICSE 2023), 13 pages, to appear,
May 2023. [PDF]
- Fuzzing Automatic Differentiation in Deep-Learning Libraries
Chenyuan Yang, Yinlin Deng, Jiayi Yao, Yuxing Tu, Hanchi Li, Lingming Zhang
Proceedings of the 45th IEEE/ACM International Conference on Software Engineering
(ICSE 2023), 13 pages, to appear,
May 2023. [PDF]
- Balancing Effectiveness and Flakiness of Non-Deterministic Machine Learning Tests
Chunqiu Steven Xia, Saikat Dutta, Sasa Misailovic, Darko Marinov, Lingming Zhang
Proceedings of the 45th IEEE/ACM International Conference on Software Engineering
(ICSE 2023), 13 pages, to appear,
May 2023. [PDF]
- MirrorTaint: Practical Non-intrusive Dynamic Taint Tracking for JVM-based Microservice Systems
Yicheng Ouyang, Kailai Shao, Kunqiu Chen, Ruobing Shen, Chao Chen, Mingze Xu, Yuqun Zhang, Lingming Zhang
Proceedings of the 45th IEEE/ACM International Conference on Software Engineering
(ICSE 2023), 13 pages, to appear,
May 2023. [PDF]
- JITfuzz: Coverage-guided Fuzzing for JVM Just-in-Time Compilers
Mingyuan Wu, Minghai Lu, Heming Cui, Junjie Chen, Yuqun Zhang, Lingming Zhang
Proceedings of the 45th IEEE/ACM International Conference on Software Engineering
(ICSE 2023), 13 pages, to appear,
May 2023. [PDF]
- Evaluating and Improving Hybrid Fuzzing
Ling Jiang, Hengchen Yuan, Mingyuan Wu, Lingming Zhang, Yuqun Zhang
Proceedings of the 45th IEEE/ACM International Conference on Software Engineering
(ICSE 2023), 13 pages, to appear,
May 2023. [PDF]
- NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers
Jiawei Liu*, Jinkun Lin*, Fabian Ruffy, Cheng Tan, Jinyang Li, Aurojit Panda, Lingming Zhang
Proceedings of 28th International Conference on Architectural Support for Programming Languages and Operating Systems
(ASPLOS 2023), 14 pages, to appear,
March 2023. [PDF][arXiv][Code]
(π This paper won an ASPLOS'23 Distinguished Artifact Award.)
- Less Training, More Repairing Please: Revisiting Automated Program Repair via Zero-shot Learning
Chunqiu Steven Xia, Lingming Zhang
Proceedings of 30th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2022), 13 pages, to appear,
November 2022. [PDF]
- Fuzzing Deep-Learning Libraries via Automated Relational API Inference
Yinlin Deng*, Chenyuan Yang*, Anjiang Wei, Lingming Zhang
Proceedings of 30th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2022), 13 pages, to appear,
November 2022. [PDF]
- Learning to Construct Better Mutation Faults
Zhao Tian, Junjie Chen, Qihao Zhu, Junjie Yang, Lingming Zhang
Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering
(ASE 2022), 13 pages, to appear, October 2022. [PDF]
(π This paper won an ACM SIGSOFT Distinguished Paper Award.)
- An Extensive Study on Pre-trained Models for Program Understanding and Generation
Zhengran Zeng, Hanzhuo Tan, Haotian Zhang, Jing Li, Yuqun Zhang, Lingming Zhang
Proceedings of the 31st ACM International Symposium on Software
Testing and Analysis
(ISSTA 2022), 13 pages, to appear, July 2022. [PDF]
- Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutation
Jiawei Liu, Yuxiang Wei, Sen Yang, Yinlin Deng, Lingming Zhang
Proceedings of the
ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications
(OOPSLA 2022), 30 pages, conditional accept,
Nov. 2022. [PDF][Code]
- Free Lunch for Testing: Fuzzing Deep-Learning Libraries from Open Source
Anjiang Wei, Yinlin Deng, Chenyuan Yang, Lingming Zhang
Proceedings of the 44th IEEE/ACM International Conference on Software Engineering
(ICSE 2022), 12 pages, to appear,
May 2022. [PDF][Code]
- Towards Boosting Patch Execution On-the-Fly
Samuel Benton, Yuntong Xie, Lan Lu, Mengshi Zhang, Xia Li, Lingming Zhang
Proceedings of the 44th IEEE/ACM International Conference on Software Engineering
(ICSE 2022), 12 pages, to appear,
May 2022. [PDF]
- History-Driven Test Program Synthesis for JVM Testing
Yingquan Zhao, Zan Wang, Junjie Chen, Mengdi Liu, Mingyuan Wu, Yuqun Zhang, Lingming Zhang
Proceedings of the 44th IEEE/ACM International Conference on Software Engineering
(ICSE 2022), 12 pages, to appear,
May 2022. [PDF]
- One Fuzzing Strategy to Rule Them All
Mingyuan Wu, Ling Jiang, Jiahong Xiang, Yanwei Huang, Heming Cui, Lingming Zhang, Yuqun Zhang
Proceedings of the 44th IEEE/ACM International Conference on Software Engineering
(ICSE 2022), 12 pages, to appear,
May 2022. [PDF]
- Evaluating and Improving Neural Program-Smoothing-based Fuzzing
Mingyuan Wu, Ling Jiang, Jiahong Xiang, Yuqun Zhang, Guowei Yang, Huixin Ma, Sen Nie, Shi Wu, Heming Cui, Lingming Zhang
Proceedings of the 44th IEEE/ACM International Conference on Software Engineering
(ICSE 2022), 12 pages, to appear,
May 2022. [PDF]
- Test-Case Prioritization for Configuration Testing
Runxiang Cheng, Lingming Zhang, Darko Marinov, Tianyin Xu
Proceedings of the 30th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2021), 14 pages, to appear, July 2021. [PDF]
(π This paper won an ACM SIGSOFT Distinguished Paper Award.)
- Deep Just-in-Time Defect Prediction: How Far Are We?
Zhengran Zeng, Yuqun Zhang, Haotian Zhang, Lingming Zhang
Proceedings of the 30th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2021), 12 pages, to appear, July 2021. [PDF]
- Boosting Coverage-Based Fault Localization via Graph-Based Representation Learning
Yiling Lou, Qihao Zhu, Jinhao Dong, Xia Li, Zeyu Sun, Dan Hao, Lu Zhang, Lingming Zhang
Proceedings of 29th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2021), 12 pages, to appear,
August 2021. [PDF]
- Fast and Precise On-the-fly Patch Validation for All
Lingchao Chen, Yicheng Ouyang, Lingming Zhang
Proceedings of the 43rd IEEE/ACM International Conference on Software Engineering
(ICSE 2021), 12 pages, to appear,
May 2021. [PDF]
- A Large-scale Study on API Misuses in the Wild
Xia Li, Jiajun Jiang, Samuel Benton, Yingfei Xiong, Lingming Zhang
Proceedings of the 14th IEEE International Conference on Software Testing, Verification and Validation
(ICST 2021), 11 pages, April 2021. [PDF]
- Evaluating and Improving Unified Debugging
Samuel Benton, Xia Li, Yiling Lou, Lingming Zhang
IEEE Transactions on Software Engineering
(TSE 2021), to appear, 2021. [PDF]
- On the Effectiveness of Unified Debugging: An Extensive Study on 16 Program Repair Systems
Samuel Benton, Xia Li, Yiling Lou, Lingming Zhang
Proceedings of the
35th IEEE/ACM International Conference on Automated Software Engineering
(ASE 2020), 12 pages, to appear,
Sept. 2020. [PDF]
- Enhanced Compiler Bug Isolation via Memoized Search
Junjie Chen, Haoyang Ma, Lingming Zhang
Proceedings of the
35th IEEE/ACM International Conference on Automated Software Engineering
(ASE 2020), 12 pages, to appear,
Sept. 2020. [PDF]
- Can Automated Program Repair Refine Fault Localization? A Unified Debugging Approach
Yiling Lou, Ali Ghanbari, Xia Li, Lingming Zhang, Haotian Zhang, Dan Hao, Lu Zhang
Proceedings of the 29th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2020), 12 pages, to appear, July 2020. [PDF]
- Empirically Revisiting and Enhancing IR-based Test-Case Prioritization
Qianyang Peng, August Shi, Lingming Zhang
Proceedings of the 29th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2020), 12 pages, to appear, July 2020. [PDF]
- Taming Behavioral Backward Incompatibilities via Cross-Project Testing and Analysis
Lingchao Chen, Foyzul Hassan, Xiaoyin Wang, Lingming Zhang
Proceedings of the 42nd IEEE/ACM International Conference on Software Engineering
(ICSE 2020), 12 pages, to appear,
May 2020. [PDF]
- Simulee: Detecting CUDA Synchronization Bugs via Memory-Access Modeling
Mingyuan Wu, Yicheng Ouyang, Husheng Zhou, Lingming Zhang, Cong Liu, Yuqun Zhang
Proceedings of the 42nd IEEE/ACM International Conference on Software Engineering
(ICSE 2020), 12 pages, to appear,
May 2020. [PDF]
- DeepBillboard: Systematic Physical-World Testing of Autonomous Driving Systems
Husheng Zhou, Wei Li, Zelun Kong, Yuankun Zhu, Yuqun Zhang, Bei Yu, Lingming Zhang, Cong Liu
Proceedings of the 42nd IEEE/ACM International Conference on Software Engineering
(ICSE 2020), 12 pages, to appear,
May 2020. [PDF]
- Practical Accuracy Estimation for Efficient Deep Neural Network Testing
Junjie Chen, Zhuo Wu, Zan Wang, Hanmo You, Lingming Zhang, Ming Yan
ACM Transactions on Software Engineering and Methodology
(TOSEM 2020), to appear, 2020. [PDF]
- Inferring Program Transformations From Singular Examples via Big Code
Jiajun Jiang, Luyao Ren, Yingfei Xiong, Lingming Zhang
Proceedings of the
34th IEEE/ACM International Conference on Automated Software Engineering
(ASE 2019), 12 pages, to appear,
Nov. 2019. [PDF]
- Automating CUDA Synchronization via Program Transformation
Mingyuan Wu, Lingming Zhang, Cong Liu, Shin Hwei Tan, Yuqun Zhang
Proceedings of the
34th IEEE/ACM International Conference on Automated Software Engineering
(ASE 2019), 12 pages, to appear,
Nov. 2019. [PDF]
- PraPR: Practical Program Repair via Bytecode Mutation
Ali Ghanbari, Lingming Zhang
Proceedings of the
32nd IEEE/ACM International Conference on Automated Software Engineering
(ASE 2019), Tool Demonstration Track, 4 pages, to appear,
Nov. 2019. [PDF]
- MuSC: A Tool for Mutation Testing of Ethereum Smart Contract
Zixin Li, Haoran Wu, Jiehui Xu, Xingya Wang, Lingming Zhang, Zhenyu Chen
Proceedings of the
32nd IEEE/ACM International Conference on Automated Software Engineering
(ASE 2019), Tool Demonstration Track, 4 pages, to appear,
Nov. 2019. [PDF]
- Reflection-Aware Static Regression Test Selection
August Shi, Milica Hadzi-Tanovic, Lingming Zhang, Darko Marinov, and Owolabi Legunsen
Proceedings of the
ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications
(OOPSLA 2019), 29 pages, to appear,
Oct. 2019. [PDF]
- Compiler Bug Isolation via Effective Witness Test Program Generation
Junjie Chen, Jiaqi Han, Peiyi Sun, Lingming Zhang, Dan Hao and Lu Zhang
Proceedings of 27th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2019), 12 pages, to appear,
August 2019. [PDF]
- Practical Program Repair via Bytecode Mutation
Ali Ghanbari, Samuel Benton, and Lingming Zhang
Proceedings of the 28th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2019), pages to appear, July 2019 [PDF]
- DeepFL: Integrating Multiple Fault Diagnosis Dimensions for
Deep Fault Localization
Xia Li, Wei Li, Yuqun Zhang, and Lingming Zhang
Proceedings of the 28th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2019), pages to appear, July 2019 [PDF]
(π This paper won an ACM SIGSOFT Distinguished Paper Award.)
- History-driven Build Failure Fixing: How Far Are We?
Yiling Lou, Junjie Chen, Lingming Zhang, Dan Hao, and Lu Zhang
Proceedings of the 28th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2019), pages to appear, July 2019 [PDF]
(π This paper won an ACM SIGSOFT Distinguished Paper Award.)
- Do Pseudo Test Suites Lead to Inflated Correlation in Measuring Test Effectiveness?
Jie Zhang, Lingming Zhang, Dan Hao, Meng Wang and Lu Zhang
Proceedings of the 12th IEEE International Conference on Software Testing, Verification and Validation
(ICST 2019), 11 pages, to appear, April 2019. [PDF]
- An Extensive Study on Cross-project Predictive Mutation Testing
Dongyu Mao, Lingchao Chen and Lingming Zhang
Proceedings of the 12th IEEE International Conference on Software Testing, Verification and Validation
(ICST 2019), 11 pages, to appear, April 2019. [PDF]
- TestSage: Regression Test Selection for Large-scale Web Service Testing
Hua Zhong, Lingming Zhang, and Sarfraz Khurshid
Proceedings of the 12th IEEE International Conference on Software Testing, Verification and Validation
(ICST 2019), Industry Track, 11 pages, to appear, April 2019. [PDF]
(π This paper won a Best Industry Paper Award.)
- DefeXts: A Curated Dataset of Reproducible Real-World Bugs for Modern JVM Languages
Samuel Benton, Ali Ghanbari, Lingming Zhang
Proceedings of the 41st IEEE/ACM International Conference on Software Engineering
(ICSE 2019), Tool Demonstration Track, 4 pages, to appear, May 2019. [PDF]
- An Empirical Study of Boosting Spectrum-based Fault Localization via PageRank
Mengshi Zhang, Yaoxian Li, Xia Li, Lingchao Chen, Yuqun Zhang, Lingming Zhang, Sarfraz Khurshid
IEEE Transactions on Software Engineering
(TSE 2019), to appear, 2019. [PDF]
- Optimizing Test Prioritization via Test Distribution Analysis
Junjie Chen, Yiling Lou, Lingming Zhang, Jianyi Zhou, Xiaoleng Wang, Dan Hao, Lu Zhang
Proceedings of 26th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2018), 12 pages, to appear,
Nov. 2018. [PDF]
- DeepRoad: GAN-based Metamorphic Testing and Input Validation Framework for Autonomous Driving Systems
Mengshi Zhang, Yuqun Zhang, Lingming Zhang, Cong Liu, Sarfraz Khurshid
Proceedings of
31st IEEE/ACM International Conference on Automated Software Engineering
(ASE 2018), 12 pages, to appear,
Sept. 2018. [PDF]
- Hybrid Regression Test Selection
Lingming Zhang
Proceedings of the 40th IEEE/ACM International Conference on Software Engineering
(ICSE 2018), 11 pages, to appear, May 2018. [PDF]
- An Extensible, Regular-Expression-Based Tool for Multi-Language Mutant Generation
Alex Groce, Josie Holmes, Darko Marinov, August Shi, Lingming Zhang
Proceedings of the 40th IEEE/ACM International Conference on Software Engineering
(ICSE 2018), Tool Demonstration Track, 4 pages, to appear, May 2018. [PDF]
- Learning to Accelerate Symbolic Execution via Code Transformation
Junjie Chen, Wenxiang Hu, Lingming Zhang, Dan Hao, Sarfraz Khurshid, Lu Zhang
Proceedings of the 32nd European Conference on Object-Oriented Programming
(ECOOP 2018), 27 pages, to appear, July 2018. [PDF]
- Speeding up Mutation Testing via Regression Test Selection: An Extensive Study
Lingchao Chen, Lingming Zhang
Proceedings of the 11th IEEE International Conference on Software Testing, Verification and Validation
(ICST 2018), 11 pages, to appear, April 2018. [PDF]
- A General Analysis Framework for Soft Real-Time Tasks
Zheng Dong, Cong Liu, Soroush Bateni, Zelun Kong, Liang He, Lingming Zhang, Ravi Prakash, Yuqun Zhang
IEEE Transactions on Parallel and Distributed Systems
(TPDS 2018), to appear, 2018. [PDF]
- How Do Static and Dynamic Test Case Prioritization Techniques Perform on Modern Software Systems? An Extensive
Study on GitHub Projects.
Qi Luo, Kevin Moran, Lingming Zhang, Denys Poshyvanyk
IEEE Transactions on Software Engineering
(TSE 2018), to appear, 2018. [PDF]
- Predictive Mutation Testing.
Jie Zhang, Lingming Zhang, Mark Harman, Dan Hao, Yue Jia, Lu Zhang
IEEE Transactions on Software Engineering
(TSE 2018), to appear, 2018. [PDF]
- Transforming Programs and Tests in Tandem for Fault Localization
Xia Li, Lingming Zhang
Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications
(SPLASH/OOPSLA 2017), to appear, Oct. 2016. [PDF]
- An Energy-efficient Offloading Framework with Predictable Temporal Correctness
Zheng Dong, Yuchuan Liu, Husheng Zhou, Yu Gu, Lingming Zhang, Cong Liu
Proceedings of the ACM/IEEE Symposium on Edge Computing
(SEC 2017), to appear, Oct. 2016. [PDF]
- Boosting Spectrum-based Fault Localization using PageRank
Mengshi Zhang, Xia Li, Lingming Zhang, and Sarfraz Khurshid
Proceedings of the 26th ACM International Symposium on Software
Testing and Analysis
(ISSTA 2017), pages 261--272, Santa Barbara, CA,
July 2017. [PDF]
- Conditional Dyck-CFL Reachability Analysis for Complete and Efficient Library Summarization
Hao Tang, Di Wang, Yingfei Xiong, Lingming Zhang, Xiaoyin Wang, Lu Zhang
Proceedings of the 26th European Symposium on Programming
(ESOP 2017), pages 880--908, Uppsala, Sweden,
April 2017. [PDF][Implementation]
- How Does Execution Information Help with Information-Retrieval Based Bug Localization?
Tung Dao, Lingming Zhang, Na Meng
Proceedings of the 25th International Conference on Program Comprehension
(ICPC 2017), to appear, Buenos Aires, Argentina,
May 2017. [PDF]
- How Do Assertions Impact Coverage-based Test-Suite Reduction?
Junjie Chen, Yanwei Bai, Dan Hao, Lingming Zhang, Lu Zhang, Bing Xie
Proceedings of the IEEE International Conference on Software Testing, Verification and Validation
(ICST 2017), Short Paper, to appear, Tokyo, Japan,
March 2017. [PDF]
- The Impacts of Techniques, Programs and Tests on Automated Program Repair: An Empirical Study
Xianglong Kong,Lingming Zhang, W. Eric Wong, and Bixin Li
Journal of Systems and Software
(JSS 2017), to appear,
June 2017. [PDF]
- Supporting Oracle Construction via Static Analysis
Junjie Chen, Yanwei Bai, Dan Hao, Lingming Zhang, Lu Zhang, Bing Xie and Hong Mei
Proceedings of
31st IEEE/ACM International Conference on Automated Software Engineering
(ASE 2016), pages 178--189, Singapore,
Sept. 2016. [PDF]
- An Extensive Study of Static Regression Test Selection in Modern Software Evolution
Owolabi Legunsen, Farah Hariri, August Shi, Yafeng Lu, Lingming Zhang, and Darko Marinov
Proceedings of 24th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2016), pages 583--594, Seattle, WA,
Nov. 2016. [PDF]
- Isomorphic Regression Testing: Executing Uncovered Branches without Test Augmentation
Jie Zhang, Yiling Lou, Lingming Zhang, Dan Hao, Lu Zhang, Hong Mei
Proceedings of 24th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2016), pages 883--894, Seattle, WA,
Nov. 2016. [PDF]
- Combinatorial Generation of Structurally Complex Test Inputs for Commercial Software Applications.
Hua Zhong, Lingming Zhang, Sarfraz Khurshid
Proceedings of 24th ACM SIGSOFT International
Symposium on the Foundations of Software Engineering
(FSE 2016), Industry track, pages 981--986, Seattle, WA,
Nov. 2016. [PDF]
(A previous short paper version appeared in NFM 2016)
- Predictive Mutation Testing
Jie Zhang, Ziyi Wang, Lingming Zhang, Dan Hao, Lei Zang, Shiyang Cheng and Lu Zhang
Proceedings of the ACM International Symposium on Software
Testing and Analysis
(ISSTA 2016), pages 342--353, Saarbrucken, Germany,
July 2016. [PDF]
- An Empirical Study on Detecting and Fixing Buffer Overflow Bugs
Tao Ye, Lingming Zhang, Linzhang Wang, Xuandong Li
Proceedings of the IEEE International Conference on Software Testing, Verification and Validation
(ICST 2016), pages 91--101, Chicago, IL, April 2016. [PDF][Data]
- How Does Regression Test Prioritization Perform in Real-World Software Evolution?
Yafeng Lu, Yiling Lou, Shiyang Cheng, Lingming Zhang, Dan Hao, Yangfan Zhou, Lu Zhang
Proceedings of the 38th IEEE/ACM International Conference on Software Engineering
(ICSE 2016), pages 535--546, Austin, TX,
May 2016. [PDF][Data]
- Experience Report: How Do Techniques, Programs, and Tests Impact Automated Program Repair?
Xianglong Kong, Lingming Zhang, W. Eric Wong, Bixin Li
Proceedings of the 26th IEEE International Symposium on Software Reliability Engineering
(ISSRE 2015), pages 194--204, Gaithersburg, MD, USA, July 2015. [PDF]
- Studying the Influence of Standard Compiler Optimizations on Symbolic Execution
Shiyu Dong, Oswaldo Olivo, Lingming Zhang, Sarfraz Khurshid
Proceedings of the 26th IEEE International Symposium on Software Reliability Engineering
(ISSRE 2015), pages 205--215, Gaithersburg, MD, USA, July 2015. [PDF]
- Experience Report: How is Dynamic Symbolic Execution Different from Manual Testing? - A Study on KLEE.
Xiaoyin Wang, Lingming Zhang, Philip Tanofsky
Proceedings of the ACM International Symposium on Software
Testing and Analysis
(ISSTA 2015), pages 199-210, Experience paper, Baltimore, Maryland,
July 2015. [PDF][Dataset]
- An Information Retrieval Approach for Regression Test Prioritization Based on Program Changes.
Ripon K. Saha, Lingming Zhang, Sarfraz Khurshid, Dewayne E. Perry
Proceedings of the 37th IEEE/ACM International Conference on Software Engineering
(ICSE 2015), pages 268--279, Firenze, Italy,
May 2015. [PDF][Implementation]
- Summary-Based Context-Sensitive Data-Dependence Analysis in Presence of Callbacks.
Hao Tang, Xiaoyin Wang, Lingming Zhang, Lu Zhang, Bing Xie, Hong Mei
Proceedings of the 42nd ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages
(POPL 2015), pages 83--95, Tata Institute of Fundamental Research, Mumbai, India,
January 2015. [PDF][Implementation]
- A Unified Test-Case Prioritization Approach.
Dan Hao, Lingming Zhang, Lu Zhang, Gregg Rothermel, and Hong Mei
ACM Transactions on Software Engineering and Methodology
(TOSEM), 24(2): 10:1-10:31. [PDF]
- Feedback-Driven Dynamic Invariant Discovery.
Lingming Zhang, Guowei Yang, Neha Rungta, Suzette Person, Sarfraz Khurshid
Proceedings of the ACM International Symposium on Software
Testing and Analysis
(ISSTA 2014), pages 362-372, Bay Area, California, July 2014. [PDF]
(A previous short paper version appeared in JPF 2013)
- Unifying Regression Testing with Mutation Testing.
Lingming Zhang
Doctoral Dissertation, Department of Electrical and Computer Engineering,
The University of Texas at Austin, May 2014. [PDF]
- Injecting Mechanical Faults to Localize Developer Faults for Evolving Software.
Lingming Zhang, Lu Zhang, Sarfraz Khurshid
Proceedings of the ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications
(SPLASH/OOPSLA 2013), pages 765--784, Indianapolis, IN , October 2013. [PDF]
- Operator-based and Random Mutant Selection: Better Together.
Lingming Zhang, Milos Gligoric, Darko Marinov, Sarfraz Khurshid
Proceedings of the 28th IEEE/ACM Conference on Automated Software Engineering
(ASE 2013), 92--102, Palo Alto, CA, November 2013. [PDF]
- Faster Mutation Testing Inspired by Test Prioritization and Reduction.
Lingming Zhang, Darko Marinov, Sarfraz Khurshid
Proceedings of the International Symposium on Software
Testing and Analysis
(ISSTA 2013), pages 235--245, Lugano, Switzerland, July 2013. [PDF][Data]
- Selective Mutation Testing for Concurrent Code.
Milos Gligoric, Lingming Zhang, Cristiano Pereira and Gilles Pokam
Proceedings of the International Symposium on Software
Testing and Analysis
(ISSTA 2013), pages 224--234, Lugano, Switzerland, July 2013. [PDF]
- Bridging the Gap Between the Total and Additional Test-Case Prioritization
Strategies.
Lingming Zhang, Dan Hao, Lu Zhang, Gregg Rothermel, Hong Mei
Proceedings of the 35th IEEE/ACM
International Conference on Software Engineering
(ICSE 2013), pages 192--201, San Francisco, CA, May 2013. [PDF]
- FaultTracer: A Spectrum-Based Approach to Localizing Failure-Inducing Program Edits.
Lingming
Zhang, Miryung Kim, Sarfraz Khurshid
Journal of Software Evolution and Process
(JSEP 2013), to appear,
2013. [PDF] An extended version of our ICSM 2011 paper.
- Regression Mutation Testing.
Lingming Zhang, Darko Marinov, Lu Zhang, Sarfraz
Khurshid
Proceedings of the International Symposium on Software
Testing and Analysis
(ISSTA
2012), pages 331--341, Minneapolis, MN, July 2012. [PDF]
- FaultTracer: A Change Impact and Regression Fault
Analysis Tool for Evolving Java Programs
Lingming Zhang, Miryung Kim, Sarfraz Khurshid
Proceedings of the 20th International Symposium On the Foundations of
Software Engineering
(FSE 2012), 4 pages, Tool Demonstration Track, Cary, NC, November 2012. [PDF]
- A Static Approach to Prioritizing JUnit Test Cases.
Hong Mei, Dan Hao,
Lingming Zhang, Lu Zhang, Gregg Rothermel
IEEE Transaction on
Software Engineering
(TSE
2012), Vol.38, No.6, November/December 2012, pp. 1258--1275. [PDF]
- Localizing failure-inducing program edits based on spectrum information.
Lingming
Zhang, Miryung Kim, Sarfraz Khurshid
Proceedings of the 27th IEEE
International Conference on Software Maintenance
(ICSM 2011), pages 23--32,
Williamsburg, VA, September 2011. [PDF] Invited to the Special Issue
of Journal of Software Maintenance and Evolution.
- An empirical study of JUnit test-suite
reduction.
Lingming Zhang, Darko Marinov, Lu Zhang, Sarfraz
Khurshid
Proceedings of the 22nd IEEE International Symposium on Software
Reliability Engineering
(ISSRE
2011), pages 170--179, Hiroshima, Japan, November 2011. [PDF]
- TestEra: A tool for testing Java programs using Alloy specifications
Shadi Abdul
Khalek, Guowei Yang, Lingming Zhang, Darko Marinov, Sarfraz Khurshid
Proceedings of the 26th IEEE/ACM International Conference On Automated
Software Engineering
(ASE 2011), pages 608--611,
Tool Demonstration Track, Lawrence, KS, November 2011. [PDF]
- Test
generation via Dynamic Symbolic Execution for mutation testing.
Lingming Zhang, Tao Xie, Lu Zhang, Nikolai Tillmann, Jonathan de Halleux,
Hong Mei
Proceedings of the 26th IEEE International Conference on
Software Maintenance
(ICSM
2010), pages 1--10, Timisoara, Romania, September 2010. [PDF]
- Prioritizing JUnit
test cases in absence of coverage information.
Lingming Zhang, Ji
Zhou, Dan Hao, Lu Zhang, Hong Mei
Proceedings of the 25th IEEE
International Conference on Software Maintenance
(ICSM 2009), pages 19--28,
Edmonton, Canada, September 2009. [PDF]
- Jtop: Managing JUnit
Test Cases in Absence of Coverage Information.
Lingming Zhang, Ji
Zhou, Dan Hao, Lu Zhang, Hong Mei
Proceedings of the 24th IEEE/ACM
International Conference on Automated Software Engineering
(ASE 2009), pages
677--679, Tool Demonstration Track, Auckland, New Zealand, November 2009. [PDF]
- VIDA: Visual
interactive debugging.
Dan Hao, Lingming Zhang, Lu Zhang, Jiasu
Sun, Hong Mei
Proceedings of the 31st IEEE/ACM International Conference
on Software Engineering
(ICSE 2009), pages
583--586, Tool Demonstration Track, Vancouver, Canada, May 2009. [PDF]