Ontology-based Automatic Reasoning and NLP for Software Traceability with the OntoTrace Tool
Context and motivation. Traceability is an essential part of quality assurance tasks for software maintainability, validation, and verification. However, the effort required to create and maintain traces is still high compared to their benefits. Problem. Some authors have proposed traceability tools to address this challenge, yet some of those tools require historical traceability data to generate traces, representing an entry barrier to software development teams that do not do traceability. Another common requirement of existing traceability tools is the scope of artefacts to be traced, hindering the adaptability of traceability tools in practice. Principal ideas. Motivated by the mentioned challenges, in this paper we propose OntoTraceV2.0: a tool for supporting trace generation of arbitrary software artefacts without depending on historical traceability data. The architecture of OntoTraceV2.0 integrates ontology-based automatic reasoning to facilitate adaptability for tracing arbitrary artefacts and natural language processing for discovering traces based on text-based similarity between artefacts. We conducted a quasi-experiment with 36 subjects to validate OntoTraceV2.0 in terms of efficiency, effectiveness, and satisfaction. Contribution. We found that OntoTraceV2.0 positively affects the subjects’ efficiency and satisfaction during trace generation compared to a manual approach. Although the subjects’ average effectiveness is higher using OntoTraceV2.0, we observe no statistical difference with the manual trace generation approach. Even though such results are promising, further replications are needed to avoid certain threats to validity. We conclude the paper by analysing the experimental results and limitations we found, drawing on future challenges, and proposing the next research endeavours.
preprint (paper_2053.pdf) | 882KiB |
Thu 20 AprDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Session R7 - NLP and ML for RE IIResearch Papers at Sitges Chair(s): Nelly Condori-Fernández Universidad de Santiago de Compostela | ||
11:00 40mTechnical design | Summarization of Elicitation Conversations to Locate Requirements-Relevant Information Research Papers P: Xavier de Bondt fizor., A: Tjerk Spijkman Utrecht University, A: Fabiano Dalpiaz Utrecht University, A: Sjaak Brinkkemper Utrecht University, D: David Mosquera Zurich University of Applied Sciences Pre-print | ||
11:40 40mTechnical design | Ontology-based Automatic Reasoning and NLP for Software Traceability with the OntoTrace Tool Research Papers P: David Mosquera Zurich University of Applied Sciences, A: Marcela Ruiz Zurich University of Applied Sciences (ZHAW), A: Oscar Pastor Universitat Politecnica de Valencia, A: Jürgen Spielberger ZHAW, D: Tjerk Spijkman File Attached |