It is currently Sat Oct 20, 2018 3:11 am Advanced search

Bigger map for preliminary rounds?

Share and discuss ideas for your entries here.

Bigger map for preliminary rounds?

Postby analyst74 » Wed Feb 17, 2010 8:30 pm

First congratulations & thanks for making such a fun and successful event!

I'd like to point out a potential issue: There is no big map in the temporary tournament but in the final. And without thorough testing, bots may get suspended in the final ranking. This would be bad for both players who got suspended and the tournament itself.

Currently the only choice is to test locally with your previous versions, and that has a few problems:
1, local machine does not emulate tournament server;
2, there is only limited scenarios can be tested, so one cannot gauge how well his/her bot can play on a bigger map (with reduced search-depth).

So, can we add a bigger map for testing on the tournament server?

Edit: corrected title
analyst74
Major
 
Posts: 39
Joined: Wed Feb 17, 2010 7:45 pm

Re: Bigger map for preliminary rounds?

Postby jeff.cameron » Thu Feb 18, 2010 6:23 am

Since the contest has increased in popularity, there is a bit of a tradeoff here. Bigger maps are more interesting, but take longer to run games on. This means that people's entries play fewer games. Smaller maps are less interesting, but allow many more games to be played each hour.

Up until a few days ago, we had some large maps of 25x25 and 30x30 in the pool. However, as the number of competitors grew, people were finding that they weren't getting enough games in to get accurate rankings. We took out the large maps, leaving a selection of 15x15 maps, and we have found that the accuracy of the rankings improved dramatically as people were able to play many more games.

Maybe we could throw some large maps into the pool, but with lower priority. That way, each submission would likely play one or two games on large maps, without totally bogging down the tournament system.
jeff.cameron
Contest Organizer
 
Posts: 91
Joined: Sun Jan 31, 2010 4:06 am

Re: Bigger map for preliminary rounds?

Postby analyst74 » Thu Feb 18, 2010 5:32 pm

I understand your concerns , although I do not think preliminary ranking means anything nor its stability to be important. But throwing in a few bigger maps with lower priority might be the best compromise.

And while we are at this, for final tournament rules. What happens if a bot performed fine in preliminary rounds but got suspended in final tournament? Will player be able to resubmit or just call it loss?
analyst74
Major
 
Posts: 39
Joined: Wed Feb 17, 2010 7:45 pm


Return to Strategy

Who is online

Users browsing this forum: No registered users and 2 guests

cron