Leaderboard

The only requirement to appear on the leaderboard is to have a successful Run.

Being on the leaderboard makes you eligible for rewards based on the rewards system of the crunch you are participating in.

Submission Phase

During the Submission Phase, the leaderboard is updated when a Run is scored.

If there is no public leaderboard, the leaderboard will be updated when a Prediction is validated to make sure it is ready for scoring.

Out-of-Sample Phase

During the Out-of-Sample Phase, the leaderboard is only updated once when all the Run that are running on unseen data are scored.

Columns

Only a subset of columns will be visible, depending on the current state of the crunch.

Name	Description
Rank	Rank of the participant / model
Participant	Name of the participant / model
Participation	Distinguish if a participant is ready for the private leaderboard (only if there is no public leaderboard)
Team	The participant's team name (only if the competition allows teams)
Best metric (unit)	The best submission score for the metric metric (reset between each rounds)
Last metric (unit)	The last submission score for the metric metric
Mean	The weighted average of the metrics (only if there are multiple)
metric (unit)	The score value of the metric metric
Run Success	The number of successful runs / the number of failed runs
Previous LB Chn	Rank change from the previous round
Public LB Chn	Rank change from the public leaderboard
Weekly Change	Rank change from the previous week
User Hist. Rewards	The amount of rewards ever received by the participant
Proj. Rewards	The amount of rewards the participant is expected to receive at the end of the month

A small view of the leaderboard, including rank changes and a metric.

Badges

Icon	Description
Crown	The participant has won the crunch
Certificate	The participant has earned a certificate
Reward	The participant has received a prize
	The participant only submitted a Quickstarter and is disqualified from receiving any rewards
	The prediction is too close to another (grouped by same user or same team, if correlation > 95%)
	The code is not deterministic (running the infer function twice give a different result)
	The score is not within the allowed range

Participant

If the crunch allows more than one model, the model name is displayed right after the participant name. Otherwise, only the participant name is displayed.

Only one Model on the Leaderboard

Some competition (like Mid+One) allow more than one model, but only ONE can be displayed on the leaderboard at any given time.

The selection can be made during the Submission Phase. After that, the button will no longer be available.

The model will be displayed on the leaderboard and will be eligible for rewards.

The model will NOT be displayed on the leaderboard and will NOT be eligible for rewards.