Friday, May 1, 2009

FAQ#5: Submitting results & scoring

Q: How often can we submit results, how are they scored, and how frequently is the leaderboard updated?

A: You can submit results once every 24 hours. The leaderboard is updated once every day, at approximately noon PST.

Results are scored by calculating the Hamming distance between the submitted results file, and the ground truth.For example, if the true state of the system is [1,0,0,1,0] and you submit [1,1,0,0,0,0], your score is 2.

No comments:

Post a Comment