Hello,
This is some results that I got with the non-visual autostart :
The settings used :
- All results are on the map 'Acropolis Bay (2)' (no modifications).
- Only Petra players.
- Only in conquest mode.
- Only 4 civilizations used.
- 200 games for each result (one row in the table beneath), with an AI seed from 0 to 199. (Some games didn't finished, 400 000 turns and still continuing.)
Players win percentages with the specific civilizations :
All the plots (made with R language) showing the evolution of the win percentage for the first player (ID=1) : Plots.zip
This shows the win percentage for a civilization against another one on the Acropolis Bay :
Note that this is only with Petra players, and if I'm not mistaken, Petra doesn't adapt its strategy in function of the civ its playing.
This shows the advantage of the starting position for a specific civilization on the Acropolis Bay :
I wrote a Java program to run multiple games, save the summaries and analyze them. But it will be better if the the possibility to run multiple games and save the summaries in a file is integrated directly in 0A.D.
Possible improvements for the non-visual autostart:
Like mimo said,
- add an option to run multiple consecutive games with the same settings but different seeds.
- add an option to impose the same civilizations on all players.
- write the summary in a log file as a JSON object, to be easier to parse later. And when you run multiple games, write all the summaries in the same file, maybe in an array or something like that.
I thought of a JSON summary that will look like that :
{
"aiseed":0,
"map":"Acropolis Bay (2)",
"victoryconditions":"conquest",
"victoryduration":0,
"totalTurns":15000,
"players":[
{
"playerID":1,
"ainame":"Petra",
"aidiff":5,
"state":"won",
"team":-1,
"statistics":{},
"civ":"brit"
}],
"extra":[]
}
The "extra" attribute will be an array of object where we could add additional informations, and if possible from anywhere in the code, especially from the AI. For example, the AI I worked on, uses different strategies over a game, and it's important to know what strategies were used to analyze them later.
And maybe, if it's possible and useful, parallelize some games, to speed up the process. This will also help not to block all the games when there's one game taking too much turns, as long as all the games running are not endless.
