• Tze Hui Liew Multimedia University, Melaka, MALAYSIA
  • Siong Hoe Lau Multimedia University, Melaka, MALAYSIA
  • Hishamuddin Ismail Multimedia University, Melaka, MALAYSIA


: We are now living in an ecosystem surrounding by interactive surface technology with its highly complex contents and applications. Pre-school children in Malaysia also face the same challenge in dealing with their edutainment which mainly resides on the multi-touch screen.  This happened even more obvious when children playing game on multi-touch screen, gestures and objects are flashing fast from multiple angel within the screen, and children are moving their figure fast to ensure that that they can perform their task accurately.  In this study, video puzzle had been employed as a metrics of evaluation to verify the level of accuracy at acquiring onscreen interactive and unstructured video puzzle pieces by pre-school children. Video puzzle is used to simulate the highly interactive, complexity, redundancies and repetitive child-computer interaction in today environment.  The interactiveness, complexity, redundancy and repetitiveness in the interaction with video puzzle could be a significant challenge to pre-school children. Therefore, it’s an urgent call for us to understand the factors affecting the visuospatial skills and touch accuracy in child-computer interaction. The observation found that pre-school children tend to synthesis, evaluate and solve the unstructured video puzzle at their own efforts and this practice lay a foundation for children to become an effective problem solver in real world uncertain yet complex situation. In addition, this study also confirmed that the main reasons of missed numbers are due to the association of the pre-school children visuospatial motor’s abilities, size of the video puzzle piece and the complexity of the interaction. The touch accuracy on multi-touch surface for video puzzle is not really determined by age but size of the video puzzle and complexity does matter. The test indicated that less complexity with bigger size video puzzle leads to better touch accuracy on multi-touch screen. When the video puzzle testing moves into size 4 x 4, whereby the video puzzle piece size become smaller, the complexity and repetitiveness of interaction increased accordingly, pre-school children started to have difficulty to accurately tab on the piece of video puzzle.


Alrashidi, M., Gardner, M., & Callaghan, V. (2017). Evaluating the Use of Pedagogical Virtual Machine with Augmented Reality to Support Learning Embedded Computing Activity. In Proceedings of the International Conference on Computer and Automation Engineering (ICCAE) (pp. 44–50). New York, New York, USA: ACM Press.
Anthony, L. (2019). Physical dimensions of children's touchscreen interactions: Lessons from five years of study on the MTAGIC project, International Journal of Human-Computer Studies, 128, 16,
Aziz, N. A. A. (2013). Children’s interaction with tablet applications: gestures and interface design, International Journal of Computer and Information Technology, 2(3), 447-450.
Baumeister, J., Ssin, S. Y., ElSayed, N. A. M., Dorrian, J., Webb, D. P., Walsh, J. A., … Thomas, B. H. (2017). Cognitive Cost of Using Augmented Reality Displays. IEEE Transactions on Visualization and Computer Graphics, 23(11), 2378–2388.
Crescenzi, L., Jewitt, C., Price, S. (2014). The role of touch in preschool children’s learning using iPad versus paper interaction. Australian Journal of Language & Literacy, 37 (2), 86-95. ISSN 1038-1562.
Cristia, A., & Seidl, A. (2015) Parental Reports on Touch Screen Use in Early Childhood. PLoS ONE 10(6): e0128338.
Davis, J. (2012). Why Puzzles Are So Important for Kids Learning? Learning 4 Kids.
Greenfield, P. M. (2009a). Linking social change and developmental change: Shifting pathways of human development. Developmental Psychology, 45, 401–418. doi:10.1037/a0014726.
Ibharim, L. F. M., Borhan, N., & Yatim, M. H. M. (2013). A field study of understanding child’s knowledge, skills and interaction towards capacitive touch technology (iPad), in 8th Int. Conf. Inf. Technol. Asia - Smart Devices Trend Technol. Futur. Lifestyle, Proc. CITA 2013, 6–10.
Ibrahim, N, Ahmad, W & Shafie, A 2016, ‘Effectiveness study on multimedia mobile application for children: Mfolktales’, Journal of Theoretical and Applied Information Technology, 15 July, vol. 89, no. 1, pp. 269-277.
ISO 9241-11:2018, Ergonomics of human-system interaction - Part 11: Usability: Definitions and concepts). Doi:
Motti, L. G., Vigouroux, N., & Gorce, P. (2014). Design of a social game for older users using touchscreen devices and observations from an exploratory study. in UAHCI, HCII 2014, Part III 8 (ed. C. Stephanidis and M. Antona), 69–78 (Springer-Verlag Berlin Heidelberg, 2014). Doi:10.1007/978-3-319-07446-7_7.
Nacher, V., Jaen, J., Navarro, E., Catala, A., & González, P. (2015). Multitouch gestures for pre-kindergarten children, Int. J. Hum. Comput. Stud., 73, 37–51.
Radesky, J., Schumacher, J., & Zuckerman, B. (2015). Mobile and interactive media use by young children: the good, the bad, and the unknown, Pediatrics Perspectives, 135(1), 1-3.
Radu, I., Guzdial, K., & Avram, S. (2017). An Observational Coding Scheme for Detecting Children’s Usability Problems in Augmented Reality. In Proceedings of the ACM International Conference on Interaction Design and Children (IDC) (pp. 643–649). New York, New York, USA: ACM Press.
Sheehan, K. J., & Uttal, D. H. (2016) Children’s Learning from Touch Screens: A Dual Representation Perspective. Front. Psychol. 7, 12-20. Doi: 10.3389/fpsyg.2016.01220.
Spivey Angela. (2010). Lose Sleep, Gain Weight: Another Piece of the Obesity Puzzle. Environmental Health Perspectives, 118(1): A28–A33. doi:
Tahir, R., & Arif, F. (2014). A measurement model based on usability metrics for mobile learning user interface for children, International Journal of E-learning and Educational Technologies in Digital media (IJEETDM), 1(1), 16–31.
Tsai, W. & Lee, C. (2009). A study on the icon feedback types of small touch screen for the elderly. Univers. Access Human-Computer Interact., 422–431. Doi:
Tumbokon, R. (2019). Smartphone and Tablet Screen Time: Good or Bad for Kids?. Raise Smart Kid. Doi:
Vatavu, R., Cramariuc, G., & Schipor, D. M. (2015). “Touch interaction for children aged 3 to 6 years: Experimental findings and relationship to motor skills,” Int. J. Hum. Comput. Stud., vol. 74, pp. 54–76.
William, P. (2011). Hamlet’s Blackberry: Building a Good Life in the Digital Age, Harper Perennial, New York; Reprint edition (August 9, 2011).
Woodward, J., Shaw, A., Aloba, A., Jain, A., Ruiz, J., & Anthony, L. (2017). Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 5–14, New York, USA: ACM Press.
How to Cite
LIEW, Tze Hui; LAU, Siong Hoe; ISMAIL, Hishamuddin. VIDEO PUZZLE: A VISUOSPATIAL BASED TOOL TO EVALUATE CHILD-MULTITOUCH INTERACTION ACCURACY. International Journal of Technology Management and Information System, [S.l.], v. 2, n. 1, p. 47-61, mar. 2020. ISSN 2710-6268. Available at: <>. Date accessed: 26 may 2024.