Single and Multi-objective Test Cases Prioritization for Self-driving Cars in Virtual Environments
ICSE 2023 Journal-First Proposal
Christian Birchler, Sajad Khatiri, Pouria Derakhshanfar, Sebastiano Panichella, and Annibale Panichella
Publication Information
- Accpetance: 27 April 2022
- Published: 24 May 2022
- Journal: TOSEM
- DOI: 10.1145/3533818
Presentation Outline
Motivation
- High testing costs for simulations
- Quality assurance for safety-critical systems
Background
- Regression Testing
- Real-world vs. simulation-based testing
- BeamNG.tech simulator
Prioritization Approach
- Genetic algorithms:
- Single-objective
- Multi-objective
- Greedy
Evaluation
- Three research questions:
- Fault detection rate
- Cost-effectiveness
- Overhead
- Random baseline
Main Findings
- Collinearity of road features
- Multi-objective outperforms
- Overhead is imperceptible
Limitations
- Reality Gap
- Limited set of traffic elements
Future Work
- More road features
- Different distance metrics
Early Impact
- Recent related studies:
- Search-Based and Fuzz Testing Workshop, co-located with ICSE
- Future plan: Create new SBFT competition called "Regression Testing Tool Competition for Self-driving Cars"
| Author | Venue |
|---|---|
| Andrea Di Sorbo et al. | TOSEM |
| Fiorella Zampetti et al. | JSS |
| Annibale Panichella et al. | EMSE |
| Qiang Hu et al. | Preprint |
| Christian Birchler et al. | Preprint |
| Author | Venue |
|---|---|
| Christian Birchler et al. | SANER |
| Aldeida Aleti et al. | Preprint |
| Annibale Panichella et al. | GECCO |
| Yao Deng et al. | ESEC/FSE |
| Sajad Khatiri et al. | ICST |
Thank you!
ICSE 2023, Melbourne, Australia, Journal-First Track