Theory-oriented evaluation for the design of and research in gaming and simulation

Jan Klabbers introduced the terms science of analysis and science of design to indicate differences between the communities of theoretical research with gaming simulation and the game design practitioners. The science of analysis uses games and simulations as research methods to test theories in various fields. Accordingly, the external validity of findings is the most important criterion of success. Research in the science of design perspective emphasizes the design of the artifact, and testing its usability.Usability refers to the idea of designing artifacts for clearly-specified contexts of use for clearly-identified audiences. However, the way both communities are interconnected and in which ways they can be of mutual benefit remains puzzling and controversial. It is our aim to discuss the potential contributions of theory-based evaluation in order to link both communities. Theory-oriented evaluation approaches are based on logic models which have the function of outlining how the simulation, its participants, and its environment interact with each other, and elicit the simulations desired outcomes. In evaluation studies, logic models are primarily used to support the planning of the evaluation design, and to provide a framework for interpreting evaluation findings. Thus, theory-oriented evaluations go beyond mere outcome-evaluations not only because they take the effects of a simulation session into consideration, but also because they aspire to identify the crucial factors which cause or moderate such effects. For this purpose, theory-oriented evaluation is assigned to the design science tradition. Its primary aim is to gain evaluative knowledge from a particular gaming simulation which can then be used to improve the simulation and its implementation for practical purposes. We will illustrate our viewpoints by discussing the theory-oriented evaluation of SIMGAME, a simulation game for business education in secondary schools. (http://sag.sagepub.com/content/37/2/268.abstract)

Data and Resources

Additional Info

Field Value
Source ISSN: 1046-8781
Author Kriz, Willy Christian, Hense, Jan
Maintainer CCSD
Last Updated May 16, 2026, 04:39 (UTC)
Created May 16, 2026, 04:39 (UTC)
Identifier hal-00704032
Language en
Rights https://about.hal.science/hal-authorisation-v1/
contributor Department Management and Research Methods ; University of Applied Sciences Vorarlberg
creator Kriz, Willy Christian
date 2006-05-16T00:00:00
harvest_object_id 19233928-e039-41ea-860f-7a46c32e6ad6
harvest_source_id 3374d638-d20b-4672-ba96-a23232d55657
harvest_source_title test moissonnage SELUNE
metadata_modified 2026-02-07T00:00:00
set_spec type:ART