-
An Empirical Study of False Negatives and Positives of Static Code Analyzers From the Perspective of Historical Issues
Han Cui, Menglei Xie, Ting Su, Chengyu Zhang, Shin Hwei Tan
pdf (under review)
-
BinPRE: Enhancing Field Inference in Binary Analysis Based Protocol Reverse Engineering
Jiayi Jiang, Xiyuan Zhang, Chengcheng Wan, Haoyi Chen, Haiying Sun, Ting Su
31th ACM Conference on Computer and Communications Security
CCS 2024, pdf, full version, tool.
-
General and Practical Property-based Testing for Android Apps
Yiheng Xiong, Ting Su, Jue Wang, Jingling Sun, Geguang Pu, Zhendong Su
39th ACM/IEEE International Conference on Automated Software Engineering
ASE 2024, pdf, tool.
ACM SIGSOFT Distinguished Paper Award
-
FIPSER: Improving Fairness Testing of DNN by Seed Prioritization
Junwei Chen, Yueling Zhang, Lingfeng Zhang, Min Zhang, Chengcheng Wan, Ting Su, Geguang Pu
39th ACM/IEEE International Conference on Automated Software Engineering
ASE 2024, pdf.
-
Finding and Understanding Defects in Static Analyzers by Constructing Automated Oracles
Weigang He, Peng Di, Mengli Ming, Chengyu Zhang, Ting Su, Shijie Li, Yulei Sui
ACM International Conference on the Foundations of Software Engineering
FSE 2024, pdf, tool.
Highlights: Our work has found 38 unique defects in Clang Static Analyzer (CSA), GCC Static Analyzer (GSA), and Pinpoint.
-
Property-based Testing for Validating User Privacy-Related Functionalities in Social Media Apps
Jingling Sun, Ting Su, Jun Sun, Jianwen Li, Mengfei Wang, Geguang Pu
ACM International Conference on the Foundations of Software Engineering
FSE 2024 (industry track), pdf, tool.
Highlights: Our work has found several user privacy leakage in Instgram (from Meta), X (Twitter) and Bilibili.
-
Evaluating the Effectiveness of Deep Learning Models for Foundational Program Analysis Tasks
Qian Chen, Chenyang Yu, Ruyan Liu, Chi Zhang, Yu Wang, Ke Wang, Ting Su, Linzhang Wang
ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications
SPLASH/OOPSLA 2024, pdf
-
Automata-based Trace Analysis for Aiding Diagnosing GUI Testing Tools for Android
Enze Ma#, Shan Huang#, Weigang He, Ting Su*, Jue Wang, Huiyu Liu, Geguang Pu, Zhendong Su
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
FSE 2023, pdf, tool [CCF-A]
(#Equal Contribution)
-
Property-based Fuzzing for Finding Data Manipulation Errors in Android Apps
Jingling Sun, Ting Su*, Jiayi Jiang, Jue Wang, Geguang Pu*, Zhendong Su
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
FSE 2023, pdf, tool [CCF-A].
-
Understanding the Reproducibility Issues of Monkey for GUI Testing
Huiyu Liu, Qichao Kong, Jue Wang*, Ting Su and Haiying Sun*
The Symposium on Dependable Software Engineering: Theories, Tools and Applications
SETTA 2023, pdf, [CCF-C]
-
Effectively Finding ICC-related Bugs in Android Apps via Reinforcement Learning
Guo Hui, Ting Su*, Xiaoqiang Liu*, Siyi Gu, Jingling Sun
The 34th IEEE International Symposium on Software Reliability Engineering
ISSRE 2023, pdf, [CCF-B]
-
An Empirical Study of Functional Bugs in Android Apps
Yiheng Xiong, Mengqian Xu, Ting Su*, Jingling Sun, Jue Wang, He Wen, Geguang Pu*, Jifeng He, Zhendong Su
32th ACM SIGSOFT International Symposium on Software Testing and Analysis
ISSTA 2023, pdf, dataset [CCF-A].
ACM SIGSOFT Distinguished Paper Award
-
ODDFUZZ: Discovering Java Deserialization Vulnerabilities via Structure-Aware Directed Greybox Fuzzing
Sicong Cao, Biao He, Xiaobing Sun, Yu Ouyang, Chao Zhang, Xiaoxue Wu, Ting Su, Lili Bo, Bin Li, Chuanlei Ma, Jiajia Li, Tao Wei
44th IEEE Symposium on Security and Privacy
S&P 2023, pdf [CCF-A].
-
Characterizing and Finding System Setting-Related Defects in Android Apps
Jingling Sun, Ting Su*, Kai Liu, Chao Peng, Zhao Zhang, Geguang Pu*, Tao Xie, Zhendong Su
IEEE Transactions on Software Engineering (TSE), 2023 (Impact Factor: 6.520), pdf, SetDroid/SetChecker [CCF-A].
Highlights: Our work (SetDroid and SetChecker) helped find 59 confirmed bugs (31 have already been fixed) in Douyin (TikTok). SetDroid has been integrated into ByteDance's official app testing infrastructure FastBot for daily testing.
-
Test Report Generation for Android App Testing via Heterogeneous Data Analysis
Chunrong Fang*, Shengcheng Yu, Ting Su*, Jing Zhang, Yuanhan Tian, Yang Liu
IEEE Transactions on Software Engineering (TSE), 2023 (Impact Factor: 6.520), pdf, [CCF-A].
-
Influential Global and Local Contexts Guided Trace Representation for Fault Localization
Zhuo Zhang, Yan Lei, Ting Su, Meng Yan, Xiaoguang Mao, Yue Yu
ACM Transactions on Software Engineering and Methodology (TOSEM), 2022 (Impact Factor: 2.674), pdf, [CCF-A].
-
Fastbot2: Reusable Automated Model-based GUI Testing for Android Enhanced by Reinforcement Learning
Zhengwei Lv, Chao Peng*, Zhao Zhang, Ting Su*, Kai Liu, Ping Yang
37th IEEE/ACM International Conference on Automated Software Engineering
ASE 2022 (industry track), pdf, [CCF-A].
Highlights: Fastbot2 has been deployed in the CI pipeline at ByteDance, and over 50% of the developer-fixed crash bugs were reported by Fastbot2.
-
Detecting Non-crashing Functional Bugs in Android Apps via Deep-State Differential Analysis
Jue Wang, Yanyan Jiang, Ting Su, Shaohua Li, Chang Xu, Jian Lu, Zhendong Su
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
ESEC/FSE 2022, pdf, [CCF-A].
-
Detecting and Fixing Data Loss Issues in Android Apps
Wunan Guo, Zhen Dong, Liwei Shen, Wei Tian, Ting Su, Xin Peng
31th ACM SIGSOFT International Symposium on Software Testing and Analysis
ISSTA 2022, pdf, iFixDataloss [CCF-A].
-
Fully Automated Functional Fuzzing of Android Apps for Detecting Non-Crashing Logic Bugs
Ting Su*, Yichen Yan, Jue Wang, Jingling Sun, Yiheng Xiong, Geguang Pu, Ke Wang, Zhendong Su
ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications
SPLASH/OOPSLA 2021, pdf, talk video, Genie [CCF-A].
Highlights: The first fully-automated GUI fuzzing technique to tackle the oracle problem in general for Andorid apps.
-
Benchmarking Automated GUI Testing for Android against Real-World Bugs
Ting Su*, Jue Wang, Zhendong Su
29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
ESEC/FSE 2021, pdf, talk video, Themis [CCF-A].
Highlights: (1) The first ground-truth empirical evaluation of automated GUI testing for Android (after ten years' continuous research by our community since 2011!).
(2) Our artifact received the Available, Functional, Reusable badge.
-
Understanding and Finding System Setting-Related Defects in Android Apps
Jingling Sun, Ting Su, Junxin Li, Zhen Dong, Geguang Pu*, Tao Xie, Zhendong Su
30th ACM SIGSOFT International Symposium on Software Testing and Analysis
ISSTA 2021, pdf, SetDroid [CCF-A].
Highlights: (1) Our technique successfully detected 17 previously unknown bugs in WeChat, QQMail, TikTok, CapCut, and AlipayHK (all these apps have billions of monthly-active users).
(2) Our artifact received the Available, Functional, Reusable badge.
-
ReCDroid+: Automated end-to-end crash reproduction from bug reports for Android apps
Yu Zhao, Ting Su, Yang Liu, Wei Zheng, Xiaoxue Wu, Ramakanth Kavuluru, William Halfond, Tingting Yu
ACM Transactions on Software Engineering and Methodology (TOSEM), 2021 (Impact Factor: 2.674), [CCF-A].
-
Feedback-Guided Circuit Structure Mutation for Testing Hardware Model Checkers
Chengyu Zhang, Minquan Sun, Jianwen Li, Ting Su, Geguang Pu
40th International Conference On Computer Aided Design
ICCAD 2021, [CCF-B].
-
Why My App Crashes? Understanding and Benchmarking Framework-specific Exceptions of Android apps
Ting Su, Lingling Fan, Sen Chen, Yang Liu, Lihua Xu, Geguang Pu, and Zhendong Su
IEEE Transactions on Software Engineering (TSE), 2020 (Impact Factor: 6.520), pdf, data [CCF-A].
An extension of our ICSE'18 paper (won an ACM SIGSOFT Distinguished Paper Award), includes: (1) a survey on how app developers analyze, debug/reproduce, detect framework-specific exceptions, (2) the reproducibility of existing app testing tools, and (3) a comprehensive dataset of android app exception bugs.
-
Improving Automated GUI Exploration of Android Apps via Static Dependency Analysis
Wunan Guo, Liwei Shen, Ting Su, Xin Peng and Weiyang Xie
36th International Conference on Software Maintenance and Evolution
ICSME 2020, pdf [CCF-B].
-
FREPA: An Automated and Formal Approach to Requirement Modeling and Analysis in Aircraft Control Domain
Jincao Feng, Weikai Miao, Hanyue Zheng, Yihao Huang, Jianwen Li, Zheng Wang,
Ting Su, BIn Gu, Geguang Pu, Mengfei Yang, Jifeng He
28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
FSE/ESEC 2020 (Industry Track), pdf [CCF-A].
-
An Empirical Assessment of Security Risks of Global Android Banking Apps
Sen Chen, Lingling Fan, Guozhu Meng, Ting Su, Minhui Xue, Yinxing Xue, Yang Liu, and Lihua Xu
42st International Conference on Software Engineering
ICSE 2020, pdf [CCF-A].
-
The Forgotten Case of the Dependency Bugs: On the Example of the Robot Operating System
Anders Fischer-Nielsen, Zhoulai Fu, Ting Su, Andrzej Wąsowski
42st International Conference on Software Engineering
ICSE 2020 (SEIP), pdf, video (YouTube).[CCF-A].
-
Finding and Understanding Bugs in Software Model Checkers
Chengyu Zhang, Ting Su*, Yichen Yan, Fuyuan Zhang, Geguang Pu and Zhendong Su
27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
ESEC/FSE 2019, pdf, slides, bug data [CCF-A].
(*Corresponding author)
Highlights: (1) We found 62 critical bugs in three state-of-the-art software model checkers (CPAchecker, Seahorn and CBMC);
(2) Searhorn and CBMC have integrated our tests as standard benchmarks.
-
Wuji: Automatic Online Combat Game Testing Using Evolutionary Deep Reinforcement Learning
Yan Zheng, Xiaofei Xie, Ting Su, Lei Ma, Jianye Hao, Zhaopeng Meng, Yang Liu, Ruimin Shen, Yinfeng Chen and Changjie Fan
34th IEEE/ACM International Conference on Automated Software Engineering
ASE 2019, pdf, press [CCF-A].
ACM SIGSOFT Distinguished Paper Award
-
Deep Differential Testing of JVM Implementations
Yuting Chen, Ting Su*, Zhendong Su
The 41st ACM/IEEE International Conference on Software Engineering
ICSE 2019, pdf [CCF-A].
-
ReCDroid: Automatically Reproducing Android Application Crashes from Bug Reports
Yu Zhao, Tingting Yu, Ting Su, Yang Liu, Wei Zheng, Jingzhi Zhang, William G.J. Halfond
The 41st ACM/IEEE International Conference on Software Engineering
ICSE 2019, pdf, Tool (ReCDroid) [CCF-A].
-
StoryDroid: Automated Generation of Storyboard for Android Apps
Sen Chen, Lingling Fan, Chunyang Chen, Ting Su, Wenhe Li, Yang Liu, Lihua Xu
The 41st ACM/IEEE International Conference on Software Engineering
ICSE 2019, pdf [CCF-A].
-
Are Mobile Banking Apps Secure? What Can be Improved?
Sen Chen, Ting Su*, Lingling Fan, Guozhu Meng, Minhui Xue, Yang Liu, Lihua Xu
The 26th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering
FSE 2018 (Industry Paper), pdf [CCF-A].
(*Corresponding author)
-
Efficiently Manifesting Asynchronous Programming Errors in Android Apps
Lingling Fan, Ting Su*, Sen Chen, Guozhu Meng, Yang Liu, Lihua Xu, Geguang Pu
The 33rd IEEE/ACM International Conference on Automated Software Engineering
ASE 2018 (acceptance rate: 19.9%), pdf [CCF-A].
(*Corresponding author)
-
DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems
Lei Ma, Felix Juefei-Xu, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Chunyang Chen, Ting Su, Li Li, Yang Liu, Jianjun Zhao, and Yadong Wang
The 33rd IEEE/ACM International Conference on Automated Software Engineering
ASE 2018 (acceptance rate: 19.9%), pdf, www [CCF-A].
ACM SIGSOFT Distinguished Paper Award
-
Large-Scale Analysis of Framework-Specific Exceptions in Android Apps
Lingling Fan#, Ting Su#*, Sen Chen, Guozhu Meng, Yang Liu, Lihua Xu, Geguang Pu and Zhendong Su
The 40th International Conference on Software Engineering
ICSE 2018 (acceptance rate: 20%), pdf, data, slides, bibtex, award, press1, press2 [CCF-A].
(#Equal Contribution, *Corresponding author)
ACM SIGSOFT Distinguished Paper Award
Highlights: (1) largest and most comprehensive fault study: collected 8,243 framework-specific exceptions (crashes) from 2,486 open-source Android apps by using Stoat and Github, and analyzed their characteristics, manifestation, and fixes. (2) motivated several follow-up research: bug detection, fault localization and patch generation.
-
From UI Design Image to GUI Skeleton: A Neural Machine Translator to Bootstrap Mobile GUI Implementation
Chunyang Chen, Ting Su*, Guozhu Meng, Zhenchang Xing and Yang Liu
The 40th International Conference on Software Engineering
ICSE 2018 (acceptance rate: 20%), pdf, tool (UI2code), press. [CCF-A].
(*Corresponding author)
-
SmartUnit: Empirical Evaluations for Automated Unit Testing of Embedded Software in Industry
Chengyu Zhang, Yichen Yan, Hanru Zhou, Yinbo Yao, Ke Wu, Ting Su*, Weikai Miao and Geguang Pu
The 40th International Conference on Software Engineering
ICSE 2018 (SEIP), pdf, slides, tool (SmartUnit) [CCF-A].
(*Corresponding author)
Highlights: (1) SmartUnit has been applied in several industry-scale embeded control systems, tested millions lines of C code.
(2) SmartUnit fully automatically supports unit testing for statement, branch, boundary value and MC/DC coverage.
-
AndroVault: Constructing Knowledge Graph from Millions of Android Apps for Automated Analysis
Guozhu Meng, Yinxing Xue, Jing Kai Siow, Ting Su, Annamalai Narayanan, Yang Liu
arXiv, 2018
-
Guided, Stochastic Model-Based GUI Testing of Android Apps
Ting Su, Guozhu Meng, Yuting Chen, Ke Wu, Weiming Yang, Yao Yao, Geguang Pu, Yang Liu, Zhendong Su
The 11th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering
FSE 2017 (acceptance rate: 24%), pdf, slides, tool (Stoat), Stoat (Google Site), bibtex, press (in Chinese) [CCF-A].
Highlights: Stoat has (1) contributted to these popular apps: WeChat (1 bug), Gmail (1 bug), and Google+ (2 bugs). All these bugs were reported and confirmed/fixed.
(2) tested 6000+ open-source and commercial Android apps in the past one year, and detected 5800+ fatal crashes.
(3) won Best Research Tool Award (First Prize, pdf) in NASAC 2017 (National Software Application Conference) held by CCF.
(3) won NTUitive Gap Fund Grant.
Best (First Place) Research Prototype Tool Award
-
A Survey on Data-Flow Testing
Ting Su, Ke Wu, Weikai Miao, Geguang Pu, Jifeng He, Yuting Chen, Zhendong Su
ACM Computing Surveys (CSUR), 2017 (Impact Factor : 6.748), pdf, data, bibtex [SCI一区]
-
Automated Coverage-driven Testing: Combining Symbolic Execution and Model Checking
Ting Su, Geguang Pu, Weikai Miao, Jifeng He, Zhendong Su
SCIENCE CHINA Information Sciences, 2016 (Impact Factor : 1.628, invited paper), pdf
-
Automated Requirements Validation for ATP Software via Specification Review and Testing
Weikai Miao, Geguang Pu, Yinbo Yao, Ting Su, Danzhu Bao, Yang Liu, Shuohao Chen and Kunpeng Xiong
The 18th International Conference on Formal Engineering Methods
ICFEM 2016, pdf
-
FSMdroid: Guided GUI Testing of Android Apps
Ting Su
The 38th International Conference on Software Engineering
ICSE 2016, ACM Student Research Competition, pdf, Press
Golden Medal (First Place) of ACM Student Research Competition
-
Coverage-Directed Differential Testing of JVM Implementations
Yuting Chen, Ting Su, Chengnian Sun, Zhendong Su, Jianjun Zhao
ACM SIGPLAN Conference on Programming Language Design and Implementation
PLDI 2016 (acceptance rate: 16%), pdf, slides, talk video [CCF-A].
-
Combining Symbolic Execution and Model Checking for Data Flow Testing
Ting Su, Zhoulai Fu, Geguang Pu, Jifeng He, Zhendong Su
37th {IEEE/ACM} International Conference on Software Engineering
ICSE 2015 (acceptance rate: 18.5%), pdf, ppt, tool (CAUT) [CCF-A].
-
Fm-QCA: A Novel Approach to Multi-value Qualitative Comparative Analysis
Ke Wu, Shiping Tang, Geguang Pu, Min Wu, Ting Su
8th International Conference on Knowledge Science, Engineering and Management
KSEM 2015, pdf
-
Automated Coverage-Driven Test Data Generation Using Dynamic Symbolic Execution
Ting Su, Siyuan Jiang, Geguang Pu, Bin Fang, Jifeng He, Jun Yan, Jianjun Zhao
Eighth International Conference on Software Security and Reliability
SERE 2014 (acceptance rate: 30%), pdf, slides
-
Runtime Verification by Convergent Formula Progression
Yan Shen, Jianwen Li, Zheng Wang, Ting Su, Bin Fang, Geguang Pu and Wangwei Liu
21st Asia-Pacific Software Engineering Conference
APSEC 2014, pdf
-
Modeling and Verification of AUTOSAR OS and EMS Application
Yunhui Peng, Yanhong Huang, Ting Su, Jian Guo
Seventh International Symposium on Theoretical Aspects of Software Engineering
TASE 2013, pdf
-
The Semantics and Verification of Timed Service Choreography
Yongxin Zhao, Hao Xiao, Zheng Wang, Geguang Pu, Ting Su
International Journal of Computer Mathematics
IJCM 2013.