When we opened the contest a few weeks ago, we actually started off with a pairing algorithm that selected bots of similar strength, and a ranking algorithm based on the famous PageRank algorithm. However, it had some subtle quirks and we were getting complaints because it wasn't as clear why you had the ranking you did. We axed it fairly early on in favor of the current ranking system, which is totally straightforward and easy to understand.
Now we may have to do better, since the current ranking system is having trouble separating the top ten entries. What if we put up some alternate non-default leaderboards that use other ranking algorithms like ELO or my failed PageRank-based algorithm? If one of these leaderboards ends up being popular, we could even make it the new official leaderboard. Remember, you can help make this happen faster by writing the code for us!
Statistics: Posted by jeff.cameron — Thu Feb 18, 2010 6:06 am