Development: New developer tool - Runner
PostPosted: 10 Oct 2012, 07:03
Yesterday I sketched up and committed new developer tool for KaM Remake called "Runner". This tool is intended to collect statistics data from gameplay simulation ran many times with different random seed. Statistics will allow to see values distribution and deviations from expected values.
Typical examples of use:
- Test fight between 2 armies to see at which point victory is a matter of raw power advantage instead of luck,
- Test AI development to see variables that allow AI to build best
- Test stone mining
- Test all maps performances, to see which maps are unusually slow
Concept is similar to DUnit TestFramework, each "Run" is a separate class that gets added to a list of available runs automatically. Runner provides Game creation and brief setup in code. Run just needs to load/setup specific conditions and specify game runtime, then return results of a run for Runner display. Thus adding new "Runs" is relatively easy task
Typical examples of use:
- Test fight between 2 armies to see at which point victory is a matter of raw power advantage instead of luck,
- Test AI development to see variables that allow AI to build best
- Test stone mining
- Test all maps performances, to see which maps are unusually slow
Concept is similar to DUnit TestFramework, each "Run" is a separate class that gets added to a list of available runs automatically. Runner provides Game creation and brief setup in code. Run just needs to load/setup specific conditions and specify game runtime, then return results of a run for Runner display. Thus adding new "Runs" is relatively easy task
