Skip to content

Commit

Permalink
Add example test
Browse files Browse the repository at this point in the history
  • Loading branch information
kyordhel committed Nov 4, 2018
1 parent 8b932c8 commit 4f88350
Show file tree
Hide file tree
Showing 2 changed files with 79 additions and 67 deletions.
74 changes: 7 additions & 67 deletions Rulebook.tex
Original file line number Diff line number Diff line change
Expand Up @@ -127,82 +127,22 @@
\chapter{Tests in Stage I}
\label{chap:stage_I}

\begin{itshape}
\iterm{Stage~I} comprehends three \textbf{ability tests} and an \textbf{integration test}.
Each ability test is designed to evaluate the average performance of the robot in one particular skill
% , providing data for benchmarking.
Meanwhile, the integration test has been designed to evaluate how this abilities work together while solving a common task.

The total score for ability and integration tests is the average of the best two performances out of preferably three performances (given the time constraints of a competition).
The point of this is to both eliminate good and bad luck for the robots/teams and to get a more objective view of the performance,
not to give teams time to tweak the robot between test performances.

\iterm{Help-me-carry} (demonstration for the audience) goes out of the arena and into the venue between the audience.

\end{itshape}

\subsection*{Scheduling}
For maximal efficiency, teams will be scheduled interleaved:
Team A does an attempt while team B sets up their robot. When A is done, it moves out the way for team B, then B attempts while A sets up the robot again etc.

The preparing team should prepare their robot close to the place of the test, but not interfere with the performing robot.
Prepared robots must wait at this preparation location until commanded to start the test.
When commanded to start, the robot must move automatically beyond this point.

Robot should be ready to start the next attempt to the same test as fast as possible:
when the performing robot is done with a attempt, the next robot must be ready to go with the start of a button or a voice command.

\newpage
\input{tests/CocktailParty}

\newpage
\input{tests/GPSR}

\newpage
\input{tests/HelpMeCarry}

\newpage
\input{tests/SPR}

\newpage
\input{tests/StoringGroceries}
% \newpage
% \input{tasks/Receptionist}
% \newpage
% \input{tasks/ServingBeverages}
% \newpage
% \input{tasks/StoringGroceries}

\chapter{Tests in Stage II}
\label{chap:stage_II}

\begin{itshape}
All ability and integration tests in \iterm{Stage~II} are performed only once. Some tests have optional tasks that grant additional points when performed correctly, clean and fast. The \iaterm{Technical Committee}{TC} must be informed if a team is planning to perform any of the optional tasks. Unless explicitly stated otherwise, no additional time is given while performing optional tasks.

In the \iterm{Open Challenge} the robot must be able to show to the \iaterm{Technical Committee}{TC} the achievements on the main research line of its own team. This test may grant up to 250 points, never exceeding the maximum scoring achieved in Stage II.

\section*{Robot \& team cooperation}
We encourage robots and teams to work together when performing tests.
For scoring, points are awarded per subtask. The robot (and thus team) performing the subtask gets the points.
For example, in the Restaurant test, if one robot of team A can take the order and another robot of team B delivers the order, then the points for taking the order go to team A, while the points for delivering go to team B.
Of course, team A \& B can both perform the test in their own turn.

\end{itshape}

\newpage
\input{tests/EEGPSR}

\newpage
\input{tests/OpenChallenge}

\newpage
\input{tests/PnG}

\newpage
\input{tests/Restaurant}

\newpage
\input{tests/TourGuide.tex}
\input{tasks/CleanTable}

\newpage
\input{tests/Finals}

\input{Appendices}

\printabx
\printidx

Expand Down
72 changes: 72 additions & 0 deletions tasks/CleanTable.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
\section{Clean the Table [House Holder]}
The robot has to remove all dishes from a table (presumably after dinner) and place them into the dishwasher.

% \subsection{Focus}
% This test focuses on object perception, manipulation, and planning.

\subsection{Main Goal}
All the tableware and cutlery is inside the dishwasher.

\noindent\textbf{Reward:} 1000pts

\subsection{Bonus rewads}
\begin{enumerate}[nosep]
\item Opening the dishwasher door (300pts)
\item Pulling out the dishwasher racks (300pts)
\item Placing the Cascade Pod inside the dishwasher (300pts)
\item Leaving the arena (100pts)
\end{enumerate}

\subsection{Setup}
\begin{itemize}[nosep]
\item \textbf{Location:} This test takes place in the arena. A dining table is located close to the dishwasher.
\item \textbf{Tray:} A plastic tray is located either on top of the dishwasher, or onto one of its racks. The tray may have tableware and cutlery placed inside already.
\item \textbf{Table setting:} The table has a total of 6 objects disposed in a typical setting for a meal for one person
Distribution is as follows:
\begin{itemize}[nosep]
\item\textit{Silverware}: Any two objects (fork, knife, spoon).
\item\textit{Tableware}: Any three objects, excluding silverware. At least one must be a dish.
\item\textit{Cascade Pod}: One Cascade Pod.
\end{itemize}
\end{itemize}


\subsection{Additional rules and remarks}
\begin{enumerate}[nosep]
\item \textbf{Safe placing:} Objects must be placed with care. It must be clear that the robot is trying to place the object, not throwing or dropping it.

\item \textbf{Dishwasher:} The team decides whether the robot will place the objects in the dishwasher's rack or in the official tray.

\item \textbf{Dishwasher door:} The dishwasher door is open and with the racks pulled out by default.
The team leader can, however, request the diswasher to be closed and score additional points for opening it. If the robot fails to open the door, it must clearly state it and request the referee to open it.

\end{enumerate}

\subsection{Referee instructions}

The referee needs to
\begin{itemize}
\item Place the table setting.
\item Place the tray on the dishwasher or onto the rack, as requested by the team.
\end{itemize}

\subsection{OC instructions}
During Setup days:
\begin{itemize}
\item Provide official cutlery and tableware for training.
\end{itemize}

2 hours before the test:
\begin{itemize}
\item Announce the predefined location to take the command.
\item Announce the predefined location of the Cascade Pod.
\end{itemize}

% \newpage
% \subsection{Score sheet}
% \input{scoresheets/CleanTable.tex}

% Local Variables:
% TeX-master: "Rulebook"
% End:

0 comments on commit 4f88350

Please sign in to comment.