Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically check failing tests in get_trigger do not result from configuration issues. #422

Open
rrrrrrockpang opened this issue Jul 26, 2021 · 0 comments

Comments

@rrrrrrockpang
Copy link

In this step (Reproducing Bugs, get_trigger.pl) , we need to a way to automatically check whether each bug candidates exist in the trigger_tests folder. The script should flag bugs for manual inspection.

Below is the pseudocode:

flagged_bugs = []
For rev_entry in rev pairs:
    check if the bug id exist in trigger test
    if no:
        determine the revision hash of the fixed version from active-bugs.csv
        look up failing test of the revision hash
        run mvn test
        
        if the errors are consistent / the number is different
              continue
        else
               flagged_bugs.append(rev_entry)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant