Section 4: Scoring & Awards
This section includes a detailed overview of the competition scoring.
Scores are calculated by the judges' evaluation and observation. All decisions of the judges are final.
4.1 Design Documentation Scoring
Design documentation must be submitted in accordance with the requirements outlined in Section 2: Design Documentation and the deadlines listed in Section 1.4: Competition Schedule and Timeline, to be eligible for full points. After the competition, the judges will issue overall standings in the design documentation portion of the competition.
Design Documentation
Potential Points
Technical Design Report
200
Website
180
Team Introduction Video
120
Design Presentation
180
System Assessment
180
Total Potential Points
860
4.2 Autonomy Challenge Scoring
The Autonomy Challenge occurs in three rounds: Qualifying Round, Semi-Finals, and Finals. For the Qualifying Round minimum performance criteria is specified and no points are awarded, as outlined in Section 3.4.
For the Semi-Final and Final Rounds points are awarded, as outlined in this section. Upon completion of the Semi-Finals Round, the judges will announce the top-scoring teams who will progress to the Finals Round. The judges have the discretion to select the number of teams advancing to the Finals Round.
Each task has a point value associated with it. Each vehicle must pass through the entry gate before attempting any other task. The tasks can be completed in any order by one or more vehicles. During a scored time slot, the team lead may end the run at any time and keep the accumulated points. The team may decide to start another run, in an attempt to accomplish more/different tasks.
Best Run: For both semi-finals and finals, the best run will be used for the final points. Therefore, a team may try to accomplish as many runs as time allows, and the run that has accumulated the most points will be used for their final score.
Thrust measurement
Generate pounds of thrust (in lbs) (Th)
100*(Th / W)
Obstacle Strike
ASV strikes buoy or obstacle (S)
25*S (max: 20)
-500-0
Task 1 – Evacuation Route & Return Entry & Exit Gate
ASV navigates through both entry gates at start of run
0,100
ASV transmits message reporting time and position of completion of entry gates
0,100
ASV returns to gates and navigates through exit gates at end of run
0,200
ASV transmits heartbeat message reporting time and position of completion of exit gates
0,100
Task 2 – Debris Clearance Navigation Channel
ASV enters debris field through channel, maneuvering through all gates
0,100
ASV exits debris field through channel, maneuvering through all gates
0,100
ASV detects red debris, avoids buoy (no circling) and transmits message reporting location (latitude/longitude)
0,100
ASV detects green debris, circles buoy (360 turn) and transmits message reporting location (latitude/longitude)
0,200
ASV transmits message reporting location (latitude/longitude) of all debris (color indicators and black buoys)
0,200
Task 3 – Emergency Response Sprint Speed Challenge
ASV passes through gate, circles yellow buoy, and exits through gate
0,200
ASV circles yellow buoy in correct direction:
* red = circle from right * green = circle from left
0,150
Task completion time (T)
250-T
ASV transmits message reporting color of indicator and time of response
0,100
Task 4 – Supply Drop Object Delivery
ASV delivers ball (B) to each black vessel (max: 3)
1st vessel: 75 2nd vessel: 125 3rd vessel: 200
ASV delivers water (W) to each orange vessel (max: 3)
1st vessel: 75 2nd vessel: 125 3rd vessel: 200
ASV transmits message reporting location and color of vessel, and type of delivery (ball or water) (points awarded once)
0,100
Task 5 – Navigate the Marina Docking
ASV enters any, unoccupied docking bay (points awarded once)
0,50
ASV docks in slip with green color indicator
0,200
ASV docks in slip with green color indicator and the lowest number sign available
0,350
ASV transmits message reporting dock (N or S) and slip number (Slip 1, 2, or 3)
0,100
Task 6 – Harbor Alert Sound Signal
ASV detects and classifies audible signal (1 vs 2 blasts) and abandons task, overrides behavior, and navigates safely to EITHER zone/task.
0,150
ASV detects and classifies audible signal (1 vs 2 blasts) and abandons task, overrides behavior, and navigates safely to CORRECT zone/task.
0,300
ASV transmits heartbeat message reporting confirmation of signal
0,150
Multiple Vehicle Scoring: Both vehicles must successfully qualify as independent vehicles to be eligible to compete in Semi-Finals. During Semi-Finals / Finals:
both vehicles are weighed independently and points earned are combined.
both vehicles must pass through entry gate to start scored run in Semi-Finals / Finals.
both vehicles are assigned the same timeslot, but are judged and scored independently.
teams only earn points for each task once.
Example: Both vehicles start the run passing through the entry gates - the team is only awarded 100 points for this behavior.
4.2.1 Inter-Vehicle Communication (IVC)
When entering multiple vehicles into the competition, teams may earn points for inter-vehicle communication (IVC). Proof of the IVC is required for judges to evaluate accordingly. The level of the communication and the complexity of the behaviors derived by the communication are what determine the level of points awarded. Teams may earn additional points if indicator lights are used when vehicles are transmitting and receiving IVC messages.
There are three tiers to consider for these points: Core, Advanced, and Disruptive
Core (1-33% of points): One-way communication attempted by a single boat without acknowledgment or action from another boat.
Example Scenario: The boat blinks green after the end of every task to alert any other boats on the course of the intent to switch tasks.
Advanced (34-66% of points): One way communication that results in acknowledgment or action observed on a second boat.
Example Scenario: The boat blinks green after the end of every task to alert any other boats on the course of the intent to switch tasks. Another boat on the course acknowledges receipt of message by flashing green twice.
Disruptive (67-100% of points): Two way communication resulting in observed cooperative or coordinated fleet behavior.
Example Scenario: Two boats coordinate the docking task so they each find one of the available open slots and station keep until the other boat has done the same, and then coordinate entering the dock slip at the same moment.
4.3 Awards
Awards are provided in three categories: Autonomy Challenge standings, Design Documentation standings, and Special Awards. Teams must be present to collect their awards, and award money will be issued within 4-6 weeks after the competition.
4.3.1 Autonomy Challenge Ranking
After the competition, RoboNation will issue Autonomy Challenge overall standings. Any team accepted into the Finals Round will be ranked ahead of all teams that did not participate in the Finals Round. Teams are awarded prize money reflective of their autonomy challenge ranking after scores are calculated. The first-place teams receive a RoboNation champion banner.
4.3.2 Design Documentation Ranking
Teams are awarded prize money reflective of their design documentation ranking after scores are calculated.
4.3.3 Special Awards
Throughout the competition, teams, judges, and staff are asked to be on the lookout for exemplary behavior from teams to acknowledge with special awards. A digital nomination form is open during the event to nominate teams for special awards. During the event, nominations are collected at the following link, until the day before finals: roboboat.org/award-nomination.
Last updated