Scoring
Spearman correlation score
Once you have submitted, your prediction will be confronted with what is happening on the market. It will be scored daily using spearman rank correlation.
Post-processing ranking (scaled leaderboard)
The last 12 rounds of the master dataset are taken into account.
Non-submissions in any round get a score of -5%. (Incentivises consistency)
Scores are normalized (between range [-1,1]) per round.
Users scoring above the 90th percentile get the same score of +1. (This is to disincentivize overfit models as anyone above a threshold gets the same score).
Finally, the scores for all rounds are averaged.
This post-processing ranking has been voted :
First proposal :
Second proposal :