[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file /includes/functions.php on line 4586: Cannot modify header information - headers already sent by (output started at /includes/functions.php:3765)
[phpBB Debug] PHP Warning: in file /includes/functions.php on line 4588: Cannot modify header information - headers already sent by (output started at /includes/functions.php:3765)
[phpBB Debug] PHP Warning: in file /includes/functions.php on line 4589: Cannot modify header information - headers already sent by (output started at /includes/functions.php:3765)
[phpBB Debug] PHP Warning: in file /includes/functions.php on line 4590: Cannot modify header information - headers already sent by (output started at /includes/functions.php:3765)
AI Challenge Forums • View topic - ~ Final Results! ~ (Tron Challenge)

It is currently Thu Apr 26, 2018 9:35 am Advanced search

~ Final Results! ~ (Tron Challenge)

News items related to the AI Challenge

Re: ~ Final Results! ~

Postby zenzike » Tue Mar 02, 2010 1:37 am

My submission just has a very strange log in the submissions log, here are the last two statements:

Feb 27th 00:11:05 entry created in db
Feb 26th 23:32:58 sucessfully entered into contest Haskell

Why would an entry be created in the db after the submission deadline, when I had a working entry half an hour before?
zenzike
Cadet
 
Posts: 4
Joined: Mon Mar 01, 2010 8:30 pm

Re: ~ Final Results! ~

Postby corey.abshire » Tue Mar 02, 2010 2:45 am

corey.abshire
Cadet
 
Posts: 4
Joined: Sun Feb 07, 2010 4:58 pm

Re: ~ Final Results! ~

Postby Accoun_ » Tue Mar 02, 2010 2:50 am

Last edited by Accoun_ on Tue Mar 02, 2010 7:11 am, edited 2 times in total.
Accoun_
Lieutenant-Colonel
 
Posts: 45
Joined: Mon Feb 15, 2010 12:29 am

Re: ~ Final Results! ~

Postby Accoun_ » Tue Mar 02, 2010 3:14 am

in the published "final results" very few games between high rating bots
In addition was used maps from the pre-game
These results do not reflect the real balance of forces
----
http://csclub.uwaterloo.ca/contest/prof ... er_id=1376
http://www.megaupload.com/?d=4XHOFGCZ
http://openpaste.org/en/19653/
Last edited by Accoun_ on Tue Mar 02, 2010 7:23 am, edited 1 time in total.
Accoun_
Lieutenant-Colonel
 
Posts: 45
Joined: Mon Feb 15, 2010 12:29 am

Re: ~ Final Results! ~

Postby amstan » Tue Mar 02, 2010 6:05 am

Alexandru M. Stan
Contest Organizer
User avatar
amstan
Contest Organizer
 
Posts: 691
Joined: Sun Jan 31, 2010 4:02 am
Location: Stoney Creek, Ontario

Re: ~ Final Results! ~

Postby dmn001 » Tue Mar 02, 2010 12:46 pm

First of all, thanks to the organisers for hosting such a fun and interesting event.

Here is a histogram of the final rankings: http://i.imgur.com/aPUio.png

I only have 2 small dislikes. I did not like that the preliminary maps made their way into the final, as I am aware some bots created customised paths based on maps, e.g. if map==quadrant, do this. I also did not like that from the selection of random maps, maps with draws were removed. There may have been some bots with specific strategies for dealing with draws, and these bots would have been at a disadvantage, due to the late announcement.

Finally, I would like to ask how the pairings were selected, how the ELO score is calculated, and if possible that the columns for win lose draw are added back to the rankings page. It seems that most if not all of the 707 participants played 216 games each. Thanks again for the contest, I really enjoyed it. :)
dmn001
Cadet
 
Posts: 3
Joined: Mon Feb 08, 2010 10:29 pm

Re: ~ Final Results! ~

Postby Fritzlein » Tue Mar 02, 2010 4:20 pm

Fritzlein
Colonel
 
Posts: 81
Joined: Thu Feb 18, 2010 9:20 pm

Re: ~ Final Results! ~

Postby jeff.cameron » Tue Mar 02, 2010 7:18 pm

Very good questions all around.

Some bots appear to have longer game histories since most of the games are against previous versions of other bots. We still display these in the game history since the old games are still useful. However, only games played between currently active submissions were used to calculate the final rankings. That is why some bots appear to have more games than others, even though they don't really.

Each of the top 50 contenders, as of halfway through the final tournament, has played against each of the other 50. In addition, this is also almost true of the top 100. Bur don't take my word for it, check it yourself. I have published a complete log of all 160,000+ games from the final tournament, along with complete map data, at jpcameron.com/blog.

The majority of games were played on randomly generated maps, as was promised. We intentionally chose maps with low draw rates, in order to make the best use of our finite CPU cycles. I grant that this makes it harder for bots to intentionally draw their games. I point out that the winning entry was not harmed by this limitation, since it was designed to win, rather than to not lose.
jeff.cameron
Contest Organizer
 
Posts: 91
Joined: Sun Jan 31, 2010 4:06 am

Re: ~ Final Results! ~

Postby Fritzlein » Tue Mar 02, 2010 7:38 pm

Fritzlein
Colonel
 
Posts: 81
Joined: Thu Feb 18, 2010 9:20 pm

Re: ~ Final Results! ~

Postby Fritzlein » Wed Mar 03, 2010 1:18 am

Hmmm, the text file of games doesn't entirely answer the question about FairScheduler. If I am parsing the file correctly, the number of games played by the participants ranges from 200 to 790, with the high and low end of the file being:

Player Wins Losses Draws Total Score
satis_ 518 191 81 790 70.70%
MadCow77 227 440 117 784 36.42%
jcazevedo 400 172 204 776 64.69%
cryptron 360 289 121 770 54.61%
NotDomo 302 347 119 768 47.07%
nicksabatino 345 330 92 767 50.98%
akogata 147 542 75 764 24.15%
Splinter 343 298 123 764 52.95%
ferson2020 398 243 122 763 60.16%
T-Bone 268 361 134 763 43.91%
[...]
leeaby 127 53 21 201 68.41%
luv2run 167 19 15 201 86.82%
marvin88 114 67 20 201 61.69%
mxooo8 112 77 12 201 58.71%
nimtech 83 99 19 201 46.02%
saalehr 100 80 21 201 54.98%
sdyy1990 141 34 26 201 76.62%
ilienert 141 45 14 200 74.00%
lsmacedo 105 84 11 200 55.25%
Tidan2 73 92 35 200 45.25%

The sharp cutoff at 200 is strange. If there were bots getting suspended at all points of the tournament, then why weren't any suspended with fewer than 200 games? If the bots at the bottom of the list didn't get more games because they were suspended, then why did so many of them all get suspended at nearly the same time? Or, finally, if some of the bots at the bottom of the list weren't suspended, why didn't they continue to get games?

In totally unrelated news, here is what the top of the standings would have been by the old score formula instead of BayesElo:

Player Wins Losses Draws Total Score
a1k0n_ 263 3 14 280 96.43%
sostratos 581 16 51 648 93.60%
hebbie 225 5 27 257 92.80%
kduleba 201 4 26 231 92.64%
DjinnKahn 268 13 19 300 92.50%
Janzert 205 6 24 235 92.34%
aramadia 216 9 20 245 92.24%
ebrahim 236 11 22 269 91.82%
jhawthorn 406 23 29 458 91.81%
_mspe_ 235 7 31 273 91.76%

The same bot would have won, but there's enough of a difference in the rest of the top ten that it clearly made a difference to take into account the strength of opposition. Thus it's a good thing that you did take the trouble to implement BayesElo. Thanks again for that!
Fritzlein
Colonel
 
Posts: 81
Joined: Thu Feb 18, 2010 9:20 pm

PreviousNext

Return to Announcements

Who is online

Users browsing this forum: No registered users and 1 guest

cron