It is currently Thu Aug 24, 2017 6:49 am Advanced search

Testing Matching and Ranking

Place where the Contest Admins can talk about the running of the contest.

Testing Matching and Ranking

Postby DanielVonFange » Tue Mar 01, 2011 3:19 pm

It would be useful to be able to test future matching and ranking algorithms to see how quickly and accurately they rank bots. Since matching and ranking affect each other, to evaluate them we need to simulate picking match, having a fight, and then adjusting the rankings. It would be painful to actually run all the battles needed to know an algorithm's performance.

I wrote a tiny python class that simulates battles based on the "Likelihood of Superiority" results from last contest. It handles server-day worth of battles in under a second.

Likelihood of Superiority Results:
Posts: 149
Joined: Wed Sep 08, 2010 1:15 pm

Return to Behind the Scenes

Who is online

Users browsing this forum: No registered users and 1 guest