Cultivating Researcher-Sensibility in Novice Designers:  Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio

Xueliang Li; H. Xue

doi:10.1007/978-3-031-35696-4_35

Cultivating Researcher-Sensibility in Novice Designers: Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio

Xueliang Li^*, H. Xue

^*Corresponding author for this work

Design Aesthetics

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

23 Downloads (Pure)

Abstract

This paper presents an eight-day design studio that teaches heuristic evaluation of games to third-year bachelor students at the School of Design, Southern University of Science and Technology. Through this course, students gain the first-hand experiences of developing heuristics for games through online survey and using them in idea generation and game evaluation. 13 students (working in groups of two or individually) developed 88 heuristics for 8 game genres by analyzing 349 quotes of game reviews collected from online. The heuristics were further developed into questionnaires and tested with invited 51 game players, followed up by post-interviews. The heuristics were also used as inspirational tools to help the students generate design ideas in an ideation exercise. Results of the students’ work indicate usefulness of the heuristics as evaluative and inspirational tools. In the discussion, we reflected on the challenges encountered by the students over the course and how dealing with these challenges could reveal further directions of teaching research methods in HCI studios.

Original language	English
Title of host publication	Design, User Experience, and Usability. HCII 2023.
Subtitle of host publication	Lecture Notes in Computer Science
Editors	A. Marcus, E. Rosenzweig, M.M. Soares
Place of Publication	Cham
Publisher	Springer Nature
Pages	483-496
Number of pages	14
Volume	14031
ISBN (Electronic)	978-3-031-35696-4
ISBN (Print)	978-3-031-35695-7
DOIs	https://doi.org/10.1007/978-3-031-35696-4_35
Publication status	Published - 2023

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14031 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

Design Education
Studio
Design Research Methodology
Design Evaluation

Access to Document

10.1007/978-3-031-35696-4_35

978-3-031-35696-4_35Final published version, 1 MB

Cite this

Li, X., & Xue, H. (2023). Cultivating Researcher-Sensibility in Novice Designers: Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio. In A. Marcus, E. Rosenzweig, & M. M. Soares (Eds.), Design, User Experience, and Usability. HCII 2023.: Lecture Notes in Computer Science (Vol. 14031, pp. 483-496). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14031 LNCS). Springer Nature. https://doi.org/10.1007/978-3-031-35696-4_35

Li, Xueliang ; Xue, H. / Cultivating Researcher-Sensibility in Novice Designers : Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio. Design, User Experience, and Usability. HCII 2023.: Lecture Notes in Computer Science. editor / A. Marcus ; E. Rosenzweig ; M.M. Soares. Vol. 14031 Cham : Springer Nature, 2023. pp. 483-496 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{b569977a5a4a4892963463b834ac8e0d,

title = "Cultivating Researcher-Sensibility in Novice Designers: Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio",

abstract = "This paper presents an eight-day design studio that teaches heuristic evaluation of games to third-year bachelor students at the School of Design, Southern University of Science and Technology. Through this course, students gain the first-hand experiences of developing heuristics for games through online survey and using them in idea generation and game evaluation. 13 students (working in groups of two or individually) developed 88 heuristics for 8 game genres by analyzing 349 quotes of game reviews collected from online. The heuristics were further developed into questionnaires and tested with invited 51 game players, followed up by post-interviews. The heuristics were also used as inspirational tools to help the students generate design ideas in an ideation exercise. Results of the students{\textquoteright} work indicate usefulness of the heuristics as evaluative and inspirational tools. In the discussion, we reflected on the challenges encountered by the students over the course and how dealing with these challenges could reveal further directions of teaching research methods in HCI studios.",

keywords = "Design Education, Studio, Design Research Methodology, Design Evaluation",

author = "Xueliang Li and H. Xue",

note = "Green Open Access added to TU Delft Institutional Repository {\textquoteleft}You share, we take care!{\textquoteright} – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.",

year = "2023",

doi = "10.1007/978-3-031-35696-4_35",

language = "English",

isbn = "978-3-031-35695-7",

volume = "14031",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Nature",

pages = "483--496",

editor = "A. Marcus and { Rosenzweig}, { E.} and M.M. Soares",

booktitle = "Design, User Experience, and Usability. HCII 2023.",

}

Li, X & Xue, H 2023, Cultivating Researcher-Sensibility in Novice Designers: Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio. in A Marcus, E Rosenzweig & MM Soares (eds), Design, User Experience, and Usability. HCII 2023.: Lecture Notes in Computer Science. vol. 14031, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14031 LNCS, Springer Nature, Cham, pp. 483-496. https://doi.org/10.1007/978-3-031-35696-4_35

Cultivating Researcher-Sensibility in Novice Designers: Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio. / Li, Xueliang; Xue, H.
Design, User Experience, and Usability. HCII 2023.: Lecture Notes in Computer Science. ed. / A. Marcus; E. Rosenzweig; M.M. Soares. Vol. 14031 Cham: Springer Nature, 2023. p. 483-496 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14031 LNCS).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Cultivating Researcher-Sensibility in Novice Designers

T2 - Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio

AU - Li, Xueliang

AU - Xue, H.

N1 - Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

PY - 2023

Y1 - 2023

N2 - This paper presents an eight-day design studio that teaches heuristic evaluation of games to third-year bachelor students at the School of Design, Southern University of Science and Technology. Through this course, students gain the first-hand experiences of developing heuristics for games through online survey and using them in idea generation and game evaluation. 13 students (working in groups of two or individually) developed 88 heuristics for 8 game genres by analyzing 349 quotes of game reviews collected from online. The heuristics were further developed into questionnaires and tested with invited 51 game players, followed up by post-interviews. The heuristics were also used as inspirational tools to help the students generate design ideas in an ideation exercise. Results of the students’ work indicate usefulness of the heuristics as evaluative and inspirational tools. In the discussion, we reflected on the challenges encountered by the students over the course and how dealing with these challenges could reveal further directions of teaching research methods in HCI studios.

AB - This paper presents an eight-day design studio that teaches heuristic evaluation of games to third-year bachelor students at the School of Design, Southern University of Science and Technology. Through this course, students gain the first-hand experiences of developing heuristics for games through online survey and using them in idea generation and game evaluation. 13 students (working in groups of two or individually) developed 88 heuristics for 8 game genres by analyzing 349 quotes of game reviews collected from online. The heuristics were further developed into questionnaires and tested with invited 51 game players, followed up by post-interviews. The heuristics were also used as inspirational tools to help the students generate design ideas in an ideation exercise. Results of the students’ work indicate usefulness of the heuristics as evaluative and inspirational tools. In the discussion, we reflected on the challenges encountered by the students over the course and how dealing with these challenges could reveal further directions of teaching research methods in HCI studios.

KW - Design Education

KW - Studio

KW - Design Research Methodology

KW - Design Evaluation

UR - http://www.scopus.com/inward/record.url?scp=85169453499&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-35696-4_35

DO - 10.1007/978-3-031-35696-4_35

M3 - Conference contribution

SN - 978-3-031-35695-7

VL - 14031

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 483

EP - 496

BT - Design, User Experience, and Usability. HCII 2023.

A2 - Marcus, A.

A2 - Rosenzweig, E.

A2 - Soares, M.M.

PB - Springer Nature

CY - Cham

ER -

Li X, Xue H. Cultivating Researcher-Sensibility in Novice Designers: Exploring Genre-Specific Heuristics for Game Evaluation in a Design Studio. In Marcus A, Rosenzweig E, Soares MM, editors, Design, User Experience, and Usability. HCII 2023.: Lecture Notes in Computer Science. Vol. 14031. Cham: Springer Nature. 2023. p. 483-496. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-35696-4_35