Game Development Reference
sessions. The results of investigating the learning
outcomes are not always straight forward - they
are dependent on the prior knowledge of partici-
pants; and non-homogeneous groups introduce
other factors. The problem with using objective
metrics is that it is very difficult to measure the
learning outcome on soft skills and also there is
a problem to measure to what extent the learners
have learned how to gather information and apply
it afterwards, i.e. to construct their own knowledge.
Since this is important for experiential learning this
is a future topic for further research. Nevertheless,
we can show positive learning effects of serious
games. We strongly recommend that monitoring
tools are built into serious games that allow the
progress of participants to be monitored during
game play. Such monitoring can then be used to
enter unexpected events into the game to push
participants' learning in the required direction.
Further, the inclusion of performance indicators
allows both participants and facilitators to point
the learning in the required direction.
Dourish, P., & Belloti, V. (1992). Awareness and
coordination in shared workspace, In [New York:
ACM Press.]. Proceedings of Computer Supported
Cooperative Work, CSCW , 92 , 107-114.
Fettke, & Loos (2004). Reference Model Evalua-
tion: Towards an Application-Oriented Approach.
Hays, R. T., & Singer, M. J. (1989). Simulation
fidelity in training system design: bridging the gap
between reality and training. New York.
Kaminsky, P., & Simchi-Levi, D. (1998). A New
Computerized Beer Game: Teaching the Value of
Integrated Supply Chain Management. In Lee, H.,
& Ming, S. N. (Eds.), Supply Chain and Technol-
ogy Management (pp. 216-225). POMS Series in
Technology and Operations Management.
Kirkpatrick, D. (1996). Evaluating training pro-
grams: The four levels . San Francisco: Berrett-
Kolb, D. A. (1984). Experiential learning: Expe-
rience as a source of learning and development .
Englewood Cliffs: Prentice-Hall.
Miller, G. A. (1956). The magical number seven,
plus or minus two: Some limits on our capacity
for processing information. Psychological Review ,
63 , 81-97. doi:10.1037/h0043158
Baalsrud Hauge, J., Duin, H., & Thoben, K. D.
(2006). Increasing the resiliency of manufactur-
ing networks through gaming. In Proceedings of
the international workshop on multidisciplinary
research on simulation methods and educational
games in industrial management . Trondheim,
Phillips, J. J. (1997). Handbook of training evalua-
tion and measurement methods (3rd ed.). Houston,
TX: Gulf Publishing.
Riedel, J. C. K. H., & Pawar, K. S. (2001). Aca-
demic & Industrial User Needs of a Concurrent
Engineering Computer Simulation Game. Concur-
rent Engineering: Research & Applications , 9 (3),
Chen, S., & Michael, D. (2005). Proof of Learn-
ing: Assessment in Serious Games. Retrieved from
de Geus, A. P. (1988). Planning as learning. Har-
vard Business Review , 66 (2), 70-74.
Rohn, W. E.Ursprung und Entwicklung des
Planspiels. In Geilhardt, T., & Mühlbrandt, T.
(Eds.), Planspiele im Personal- und Organisa-
tionsmanagement (pp. 57-67). Göttingen.
DeGEval (2003, October). Standards für Evalu-