Friday, May 1, 2009

FAQ#4: Hey, people might cheat!

Q: Will the leaderboard allow the participants use the evaluation results as "feedback" to tune their algorithms?

A: Please do not do this! It is pointless...

The Data Challenge is about promoting the exchange of innovative ideas and advancing PHM as a scientific discipline. Please compete fairly, and do not try to game the system. You may score well on the leaderboard, but ultimately you will have to publish your approach, and if it is incapable of achieving similar results on a holdout dataset, you will be disqualified.

Note that in the spirit of fair competition, we allow only one account per team. Please do not register multiple times under different user names, under fictitious names, or using anonymous accounts. Competition organizers reserve the right to delete multiple entries from the same person (or team) and will aggressively disqualify those who are trying to game the system or use fictitious identities.

No comments:

Post a Comment