WINE: Warning miner for improving bug finders
Y Choi, J Nam - Information and Software Technology, 2023 - Elsevier
Y Choi, J Nam
Information and Software Technology, 2023•ElsevierContext: Bug finders have been actively used to efficiently detect bugs. However, developers
and researchers found that the bug finders show high false positive rate. The false positives
can be caused by two major reasons:(1) users rejecting warnings and (2) false-positive
inducing issues (FPI), ie, incorrect or incomplete rule implementations. Objective: The
objective of this study is to reduce warning validation costs for developers of bug finders
when they validate the implementation of bug finders to reduce false positives caused by …
and researchers found that the bug finders show high false positive rate. The false positives
can be caused by two major reasons:(1) users rejecting warnings and (2) false-positive
inducing issues (FPI), ie, incorrect or incomplete rule implementations. Objective: The
objective of this study is to reduce warning validation costs for developers of bug finders
when they validate the implementation of bug finders to reduce false positives caused by …
Context
Bug finders have been actively used to efficiently detect bugs. However, developers and researchers found that the bug finders show high false positive rate. The false positives can be caused by two major reasons: (1) users rejecting warnings and (2) false-positive inducing issues (FPI), i.e., incorrect or incomplete rule implementations.
Objective
The objective of this study is to reduce warning validation costs for developers of bug finders when they validate the implementation of bug finders to reduce false positives caused by FPI.
Methods
To achieve the objective, we propose a novel approach, WINE. The key idea of WINE is to extract representative warnings that are structurally equal to other warnings, or structurally contain other warnings from numerous warnings. The rationale behind the approach is that the warnings detected based on structural information and tokens might be equal to each other, or contain other warnings structurally.
Results
We evaluated our approach with PMD, an open source bug finder, and 1,008 Java open source projects maintained by Apache Software Foundation. As a result, WINE extracted just about 2% of all warnings. Among the 2% of warnings, we could find the 28 FPIs of PMD. Among them, ten FPIs were already fixed among them. In addition, we simulated our approach in regression testing of PMD with twelve versions changes of PMD (6.25.0 to 6.37.0). As a result, we observed that WINE can effectively reduce the inspection costs by removing about 95% changed warnings.
Conclusion
Based on the results, we suggest that WINE could be adopted to improve the bug finders in terms of reducing false positives cause by FPI. In addition, WINE is helpful in the development processes of bug finders to identify false positives and false negatives, especially in regression testing of bug finders.
Elsevier
Showing the best result for this search. See all results