We use cookies to improve your experience with our site.

基于演化算法的RTS游戏者行为中噪声影响的适应度优化

Effect of Noisy Fitness in Real-Time Strategy Games Player Behaviour Optimisation Using Evolutionary Algorithms

  • 摘要: 本文研究了为进化星球大战游戏中一个程序(文中称为马蝇)的决策引擎特别设计的进化算法(EA)的性能和结果。该游戏在2010年被选为Google人工智能挑战, 它要求马蝇应对多个目标星球的同时为了战胜不同场景中的不同对手需要达到某种程度的自适应性。马蝇的决策引擎最初基于在一系列经验研究后定义的规则, 此外一种遗传算法(GA)用来调整常量集合、权值和规则所包含的概率, 从而得到马蝇的总体行为。然后, 为马蝇提供进化的决策引擎, 充分地分析与其他马蝇(一个马蝇作为练习对手由Google提供, 一个脚本的马蝇有预先确定的行为)竞争的结果。对备选解的评价基于与其它马蝇之间不确定性战争(以及环境的相互作用)的结果, 取决于随机抽取和对手的行为。因此, 提出的GA用来处理带有噪声的适应度函数。在分析噪声的影响之后, 我们总结出通过重复的战斗和重新评估来处理随机性质减少了这种影响, 使得GA对解决这个问题是一个很有价值的方法。

     

    Abstract: This paper investigates the performance and the results of an evolutionary algorithm (EA) specifically designed for evolving the decision engine of a program (which, in this context, is called bot) that plays Planet Wars. This game, which was chosen for the Google Artificial Intelligence Challenge in 2010, requires the bot to deal with multiple target planets, while achieving a certain degree of adaptability in order to defeat different opponents in different scenarios. The decision engine of the bot is initially based on a set of rules that have been defined after an empirical study, and a genetic algorithm (GA) is used for tuning the set of constants, weights and probabilities that those rules include, and therefore, the general behaviour of the bot. Then, the bot is supplied with the evolved decision engine and the results obtained when competing with other bots (a bot offered by Google as a sparring partner, and a scripted bot with a pre-established behaviour) are thoroughly analysed. The evaluation of the candidate solutions is based on the result of non-deterministic battles (and environmental interactions) against other bots, whose outcome depends on random draws as well as on the opponents' actions. Therefore, the proposed GA is dealing with a noisy fitness function. After analysing the effects of the noisy fitness, we conclude that tackling randomness via repeated combats and reevaluations reduces this effect and makes the GA a highly valuable approach for solving this problem.

     

/

返回文章
返回