The future of problem solving research is not complexity, but dynamic uncertainty

  • Magda Osman (Author)
  • Denis Omar Verduga Palencia (Author)

Identifiers (Article)


Research on complex problem solving (CPS) has reached a stage where certain standards have been achieved, whereas the future development is quite ambiguous. In this situation, the editors of the Journal of Dynamic Decision Making asked a number of representative authors to share their point of view with respect to seven questions about the relevance of (complex) problem solving as a research area, about the contribution of laboratory-based CPS research to solving real life problems, about the roles of knowledge, strategies, and intuition in CPS, and about the existence of expertise in CPS.




Dörner, D., & Funke, J. (2017). CPS: what it is and what it is not. Frontiers in psychology, 8, 1153. doi: 10.3389/fpsyg.2017.01153

Gershman, S.J.(2018). Deconstructing the human algorithms for exploration. Cognition, 173, 34-42. doi: 10.1016/j.cognition.2017.12.014

Kluge, A. (2014). The acquisition of knowledge and skills for taskwork and teamwork to control complex technical systems: A cognitive and macroergonomics perspective. Heidelberg: Springer. doi: 10.1007/978-94-007-5049-4

Leibo, J.Z., d’Autume, C.D., Zoran, D., Amos, D., Beattie, C., Anderson, K., Castañeda, A.G., Sanchez, M., Green, S., Gruslys, A., Legg, S., Hassabis, D., & Botvinick, M.M. (2018). Psych-lab: A Psychology Laboratory for Deep Reinforcement Learning Agents. ArXiv, abs/1801.08116

Lewandowsky, S., Mann, M., Brown, N., & Friedman, H. (2016). Science and the Public: Debate, Denial, and Skepticism. Journal of Social and Political Psychology 4 (2), 537–553. doi: 10.5964/jspp.v4i2.604

Liu, P., & Li, Z. (2012). Task complexity: A review and conceptualization framework. International Journal of Industrial Ergonomics, 42 (6), 553-568. doi: 10.1016/j.ergon.2012.09.001

Mehlhorn, K., Newell, B. R., Todd, P. M., Lee, M. D., Morgan, K., Braithwaite, V. A., ... & Gonzalez, C. (2015). Unpacking the exploration–exploitation tradeoff: A synthesis of human and animal literatures. Decision, 2 (3), 191- 215. doi:10.1037/dec0000033

Melnikoff, D. E., & Bargh, J. A. (2018). The mythical number two. Trends in cognitive sciences, 22 (4), 280-293. doi: 10.1016/j.tics.2018.02.001

Menelas, B.-A.J., Benaoudia, R.S. (2017). Use of Haptics to Promote Learning Outcomes in Serious Games. Multimodal Technologies Interact, 1, 31. doi: 10.3390/mti1040031

Milella, F. (2015) Problem-Solving by Immersive Virtual Reality: Towards a More Efficient Product Emergence Process in Automotive. Journal of Multidisciplinary Engineering Science and Technology (JMEST), 2 (4), 860 - 867.

Müller, R., & Oehm, L. (2019). Process industries versus discrete processing: how system characteristics affect operator tasks. Cognition, Technology & Work, 21 (2), 337-356. doi: 10.1007/s10111-018-0511-1

Newell, A.; Shaw, J.C.; Simon, H.A. (1959). Report on a general problem-solving program. Proceedings of the International Conference on Information Processing, 256–264.

Osman, M. (2008). Observation can be as effective as action in problem solving. Cognitive Science, 32 (1), 162-183. doi:10.1080/03640210701703683

Osman, M. (2010a). Controlling uncertainty: a review of human behavior in complex dynamic environments. Psychological bulletin, 136 (1), 65-86. doi:10.1037/a0017815

Osman, M. (2010b). Controlling uncertainty: Decision making and learning in complex worlds. John Wiley & Sons. doi: 10.1002/9781444328226

Osman, M. (2014). Future-minded: The psychology of agency and control. London, UK: Macmillan International Higher Education.

Osman, M. (2015). Future-minded: the role of prospection in Agency, Control, and other goal-directed processes. Frontiers in psychology, 6, 154. doi: 10.3389/fpsyg.2015.00154

Osman, M. (2017). Planning and Control. The Oxford Handbook of Causal Reasoning, 279-293. doi: 10.1093/oxfordhb/9780199399550.013.19

Osman, M. (2018). Persistent Maladies: The Case of Two-Mind Syndrome. Trends in cognitive sciences, 276-277. doi: 10.1016/j.tics.2018.02.005

Parker, S. C. (1920a). Problem-Solving or Practice in Thinking. I. The Elementary School Journal, 21 (1), 16-25. doi: 10.1086/454872

Parker, S. C. (1920b). Problem-Solving or Practice in Thinking. II. The Elementary School Journal, 21 (2), 98-111. doi: 10.1086/454872

Parker, S. C. (1920c). Problem-Solving or Practice in Thinking. III. The Elementary School Journal, 21 (3), 174-188. doi: 10.1086/454912

Parker, S. C. (1920d). Problem-Solving or Practice in Thinking. IV. The Elementary School Journal, 21 (4), 257-272. doi: 10.1086/454933

Quesada, J., Kintsch, W., & Gomez, E. (2005). Complex problem-solving: a field in search of a definition? Theoretical issues in ergonomics science, 6 (1), 5-33. doi: 10.1080/14639220512331311553

Robertson, G., & Watson, I. (2014). A Review of Real-Time Strategy Game AI. AI Magazine, 35 (4), 75-104. doi: 10.1609/aimag.v35i4.2478

Schoppek, W. (2002). Examples, rules, and strategies in the control of dynamic systems. Cognitive Science Quarterly, 2 (1), 63-92.

Schoppek, W. (2004). Teaching structural knowledge in the control of dynamic systems: Direction of causality makes a difference. Proceedings of the Annual Meeting of the Cognitive Science Society, 26 (26).

Schoppek, W., Kluge, A., Osman, M., & Funke, J. (2018). CPS beyond the psychometric approach. Frontiers in psychology, 9, 1224. doi: 10.3389/978-2-88945-573-7

Toda, M. (1962). The design of a fungus-eater: A model of human behavior in an unsophisticated environment. Behavioral Science, 7 (2), 164-183. doi: 10.1002/bs.3830070203

Verduga, D, O., & Osman, M. (2019a). Investigating the exploration-exploitation trade-off in dynamic environments with multiple agents. Proceedings of the 41st Annual Meeting of the Cognitive Science Society, Montreal, Canada.

Verduga, D, O., & Osman, M. (2019b). PsyRTS: A Web Platform for Experiments in Human Decision-Making in RTS Environments. IEEE Conference on Games (CoG), London, UK. doi: 10.1109/cig.2019.8848101

Vinyals, O., Babuschkin, I., Chung, J., Mathieu, M., Jaderberg, M., et al. (2019). AlphaStar: Mastering the Real-Time Strategy Game StarCraft II. URL:

Woods, D. D., & Hollnagel, E. (1987). Mapping cognitive demands in complex problem-solving worlds. International Journal of Man-Machine Studies, 26 (2), 257-275. doi: 10.1016/s0020-7373(87)80095-0