General video game evaluation using relative algorithm performance profiles

Thorbjørn S. Nielsen, Gabriella A B Barros, Julian Togelius, Mark J. Nelson

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    In order to generate complete games through evolution we need generic and reliably evaluation functions for games. It has been suggested that game quality could be characterised through playing a game with different controllers and comparing their performance. This paper explores that idea through investigating the relative performance of different general game-playing algorithms. Seven game-playing algorithms was used to play several hand-designed, mutated and randomly generated VGDL game descriptions. Results discussed appear to support the conjecture that well-designed games have, in average, a higher performance difference between better and worse game-playing algorithms.

    Original languageEnglish (US)
    Title of host publicationApplications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings
    PublisherSpringer Verlag
    Pages369-380
    Number of pages12
    Volume9028
    ISBN (Print)9783319165486
    DOIs
    StatePublished - 2015
    Event18th European Conference on the Applications of Evolutionary Computation, EvoApplications 2015 - Copenhagen, Denmark
    Duration: Apr 8 2015Apr 10 2015

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume9028
    ISSN (Print)03029743
    ISSN (Electronic)16113349

    Other

    Other18th European Conference on the Applications of Evolutionary Computation, EvoApplications 2015
    CountryDenmark
    CityCopenhagen
    Period4/8/154/10/15

    Fingerprint

    Video Games
    Game
    Evaluation
    Function evaluation
    Controllers
    Profile
    Evaluation Function
    High Performance
    Controller

    ASJC Scopus subject areas

    • Computer Science(all)
    • Theoretical Computer Science

    Cite this

    Nielsen, T. S., Barros, G. A. B., Togelius, J., & Nelson, M. J. (2015). General video game evaluation using relative algorithm performance profiles. In Applications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings (Vol. 9028, pp. 369-380). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9028). Springer Verlag. https://doi.org/10.1007/978-3-319-16549-3_30

    General video game evaluation using relative algorithm performance profiles. / Nielsen, Thorbjørn S.; Barros, Gabriella A B; Togelius, Julian; Nelson, Mark J.

    Applications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings. Vol. 9028 Springer Verlag, 2015. p. 369-380 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9028).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Nielsen, TS, Barros, GAB, Togelius, J & Nelson, MJ 2015, General video game evaluation using relative algorithm performance profiles. in Applications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings. vol. 9028, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9028, Springer Verlag, pp. 369-380, 18th European Conference on the Applications of Evolutionary Computation, EvoApplications 2015, Copenhagen, Denmark, 4/8/15. https://doi.org/10.1007/978-3-319-16549-3_30
    Nielsen TS, Barros GAB, Togelius J, Nelson MJ. General video game evaluation using relative algorithm performance profiles. In Applications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings. Vol. 9028. Springer Verlag. 2015. p. 369-380. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-16549-3_30
    Nielsen, Thorbjørn S. ; Barros, Gabriella A B ; Togelius, Julian ; Nelson, Mark J. / General video game evaluation using relative algorithm performance profiles. Applications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings. Vol. 9028 Springer Verlag, 2015. pp. 369-380 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{5117b4b19dfe482ab526b55752fddacd,
    title = "General video game evaluation using relative algorithm performance profiles",
    abstract = "In order to generate complete games through evolution we need generic and reliably evaluation functions for games. It has been suggested that game quality could be characterised through playing a game with different controllers and comparing their performance. This paper explores that idea through investigating the relative performance of different general game-playing algorithms. Seven game-playing algorithms was used to play several hand-designed, mutated and randomly generated VGDL game descriptions. Results discussed appear to support the conjecture that well-designed games have, in average, a higher performance difference between better and worse game-playing algorithms.",
    author = "Nielsen, {Thorbj{\o}rn S.} and Barros, {Gabriella A B} and Julian Togelius and Nelson, {Mark J.}",
    year = "2015",
    doi = "10.1007/978-3-319-16549-3_30",
    language = "English (US)",
    isbn = "9783319165486",
    volume = "9028",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    publisher = "Springer Verlag",
    pages = "369--380",
    booktitle = "Applications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings",

    }

    TY - GEN

    T1 - General video game evaluation using relative algorithm performance profiles

    AU - Nielsen, Thorbjørn S.

    AU - Barros, Gabriella A B

    AU - Togelius, Julian

    AU - Nelson, Mark J.

    PY - 2015

    Y1 - 2015

    N2 - In order to generate complete games through evolution we need generic and reliably evaluation functions for games. It has been suggested that game quality could be characterised through playing a game with different controllers and comparing their performance. This paper explores that idea through investigating the relative performance of different general game-playing algorithms. Seven game-playing algorithms was used to play several hand-designed, mutated and randomly generated VGDL game descriptions. Results discussed appear to support the conjecture that well-designed games have, in average, a higher performance difference between better and worse game-playing algorithms.

    AB - In order to generate complete games through evolution we need generic and reliably evaluation functions for games. It has been suggested that game quality could be characterised through playing a game with different controllers and comparing their performance. This paper explores that idea through investigating the relative performance of different general game-playing algorithms. Seven game-playing algorithms was used to play several hand-designed, mutated and randomly generated VGDL game descriptions. Results discussed appear to support the conjecture that well-designed games have, in average, a higher performance difference between better and worse game-playing algorithms.

    UR - http://www.scopus.com/inward/record.url?scp=84925860070&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84925860070&partnerID=8YFLogxK

    U2 - 10.1007/978-3-319-16549-3_30

    DO - 10.1007/978-3-319-16549-3_30

    M3 - Conference contribution

    SN - 9783319165486

    VL - 9028

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 369

    EP - 380

    BT - Applications of Evolutionary Computation - 18th European Conference, EvoApplications 2015, Proceedings

    PB - Springer Verlag

    ER -