Download PDFOpen PDF in browser

Combining Evolutionary Search with Behaviour Cloning for Procedurally Generated Content

12 pagesPublished: July 18, 2022

Abstract

In this work, we consider the problem of procedural content generation for video game levels. Prior approaches have relied on evolutionary search (ES) methods capable of gener- ating diverse levels, but this generation procedure is slow, which is problematic in real-time settings. Reinforcement learning (RL) has also been proposed to tackle the same problem, and while level generation is fast, training time can be prohibitively expensive. We propose a framework to tackle the procedural content generation problem that combines the best of ES and RL. In particular, our approach first uses ES to generate a sequence of levels evolved over time, and then uses behaviour cloning to distil these levels into a policy, which can then be queried to produce new levels quickly. We apply our approach to a maze game and Super Mario Bros, with our results indicating that our approach does in fact decrease the time required for level generation, especially when an increasing number of valid levels are required.

Keyphrases: Behaviour Cloning, evolutionary search, procedural content generation

In: Aurona Gerber (editor). Proceedings of 43rd Conference of the South African Institute of Computer Scientists and Information Technologists, vol 85, pages 77--88

Links:
BibTeX entry
@inproceedings{SAICSIT2022:Combining_Evolutionary_Search_with,
  author    = {Nicholas Muir and Steven James},
  title     = {Combining Evolutionary Search with Behaviour Cloning for Procedurally Generated Content},
  booktitle = {Proceedings of 43rd Conference of the South African Institute of Computer Scientists and Information Technologists},
  editor    = {Aurona Gerber},
  series    = {EPiC Series in Computing},
  volume    = {85},
  pages     = {77--88},
  year      = {2022},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {https://easychair.org/publications/paper/4rtK},
  doi       = {10.29007/qpkt}}
Download PDFOpen PDF in browser