LPCVC-Referee

The evaluation systems (referee) for the 2020 and 2021 Low Power Computer Vision Challenge.

Using the Referee (2021)

Installing Program to Score Submission

You need to clone this repository, and then run the following command.

python3 setup.py install

This will make the script 'test-solution' available to you in any working directory. As a result, you can run the program from any directory without the need to pinpoint the location of the script.

test-solution [-t Threshold] [Submitted CSV file] [Correct CSV File]

Threshold: Integer that corresponds to the number of frames away the submitted input answer can be from the correct input when tracking when a ball is caught. This is an optional argument, and the default is 10. Submitted CSV File: Result CSV file from submission. Correct CSV File: The Ground Truth CSV file.

The end goal is for the Submitted CSV File to closely relate to the Correct CSV File in order to detect the accuracy of your solution.

How The Score is Determined