Iva Vasic
Skip Abstract Section
Abstract
The understanding of how users interact with the virtual cultural heritage could provide digital curators valuable insights into user behaviors, and also improve the overall user experience through the ability to observe and record interactions of virtual visitors. This paper introduces the new User Behavior (UB) tracking algorithm that we developed investigating a salience of the Virtual Reality (VR) panoramic regions. The algorithm extracts the importance of Region of Interest (ROI) determining patterns of the visitors’ virtual movement and interest in combination with statistics of captured browser activity. The input of our algorithm is the virtual online interactive platform (Virtual Museum of the Civic Art Gallery of Ascoli Piceno in Italy) with eighty-one 16386x8192 pixels panoramic images and several interactive features including maps, thumbnails, and menus. The software engine of the tracking model “Vice Versa” VR (3VR) operates on inverse functions of all descriptive functions (descriptors), which are assigned particularly to each interactive feature such as viewing multimedia content and observing the panoramic environment. The tracking experiment was performed online and the web virtual museum key study collected behavior information from 171 visitors around the world. Collected data, multimedia and textual content, and the coordinates of the ROIs are then subjected to standard statistics operations in order to define common patterns of UBs. Thus, we have discovered that the ROIs are mostly mapped onto the artworks and it is possible to obtain patterns about the main interests of users. The developed tool offers a guideline for the panoramic tours design and the potential benefits for museums are to understand the public, verify the effectiveness of choices, and re-shape a cultural offer based on visitors’ needs. Exploiting this kind of user experience, our algorithm ensures relevant feedback during virtual visits, and thus paves the way for further development of the recommender system.
- Petroc Taylor. Digital transformation - statistics & facts, June 2022. URL https://www.statista.com/topics/6778/digital-transformation/#editorsPicks.Google Scholar
- UNESCO. Museums around the world in the face of covid-19, 2020. URL https://unesdoc.unesco.org/ark:/48223/pf0000373530.Google Scholar
- ICOM. Presentation of the proposal for a new definition of ‘museum’, 2022. URL https://icom.museum/en/resources/standards-guidelines/museum-definition/#:~:text=PROPOSAL%20OF%20MUSEUM%20DEFINITION,museums%20foster%20diversity%20and%20sustainability.Google Scholar
- Tula Giannini and Jonathan P. Bowen. Museums and digital culture: From reality to digitality in the age of covid-19. Heritage, 5(1):192–214, Jan 2022. ISSN 2571-9408. doi: 10.3390/heritage5010011. URL http://dx.doi.org/10.3390/heritage5010011.Google ScholarCross Ref
- Alireza Gholinejad Pirbazari and Sina Kamali Tabrizi. Recordim of iran’s cultural heritage using an online virtual museum, considering the coronavirus pandemic. Journal on Computing and Cultural Heritage, 15(2), apr 2022. ISSN 1556-4673. doi: 10.1145/3500925. URL https://doi.org/10.1145/3500925.Google ScholarDigital Library
- Christofer Meinecke, Chris Hall, and Stefan Jänicke. Towards enhancing virtual museums by contextualizing art through interactive visualizations. J. Comput. Cult. Herit., 15(4), dec 2022. ISSN 1556-4673. doi: 10.1145/3527619. URL https://doi.org/10.1145/3527619.Google ScholarDigital Library
- Europeana. European digital library cenl, edl & edlnet, 2008. URL https://www.eesc.europa.eu/sites/default/files/resources/docs/jill-cousins-cese-brussels-171007.pdf.Google Scholar
- Danish Business Authority. The digital agenda for europe, 2010. URL https://danishbusinessauthority.dk/digital-agenda-europe#:~:text=The%20Digital%20Agenda%20for%20Europe%20was%20launched%20in%20May%202010,is%20much%20wider%20in%20scope.Google Scholar
- European Commission, Directorate-General for the Information Society, Media, M Lévy, E Niggemann, and J De Decker. The new renaissance: report of the Comité des Sages on bringing Europe’s cultural heritage online. Publications Office, 2011. doi: doi/10.2759/45571.Google Scholar
- Digital meets culture. Implementation of commission recommendation on the digitisation and online accessibility of cultural material and digital preservation, 2011. URL https://www.digitalmeetsculture.net/wp-content/uploads/2019/06/ReportonCulturalHeritageDigitisationOnlineAccessibilityandDigitalPreservation.pdf.Google Scholar
- EC. A new european agenda for culture (eych), 2018. URL https://culture.ec.europa.eu/sites/default/files/2020-08/swd-2018-167-new-european-agenda-for-culture_en.pdf.Google Scholar
- EC. Leeuwarden declaration - adaptive re-use of the built heritage: Preserving and enhancing the values of our built heritage for future generations, 2018. URL https://culture.ec.europa.eu/sites/default/files/2020-08/swd-2018-167-new-european-agenda-for-culture_en.pdf.Google Scholar
- Florin Nechita and Catalina-Ionela Rezeanu. Augmenting museum communication services to create young audiences. Sustainability, 11(20). ISSN 2071-1050. URL https://www.mdpi.com/2071-1050/11/20/5830.Google Scholar
- Google Inc. Google arts & culture, 2011. URL https://artsandculture.google.com/.Google Scholar
- Renato Angeloni, Roberto Pierdicca, Adriano Mancini, Marina Paolanti, and Andrea Tonelli. Measuring and evaluating visitors’ behaviors inside museums: the co.me. project. SCIRES-IT - SCIentific RESearch and Information Technology, 11:167–178, 7 2021. ISSN 2239-4303. doi: 10.2423/I22394303V11N1P167. URL http://www.sciresit.it/article/view/13556.Google ScholarCross Ref
- Istituzione Bologna Musei ENEA. Shareart, 2021. URL https://ict.enea.it/event/beni-culturali-al-via-il-progetto-shareart-per-misurare-il-gradimento-delle-opere-darte-con-lintelligenza-artificiale/.Google Scholar
- Yicheng Jiang, Xia Zheng, and Chao Feng. Towards multi-area contactless museum visitor counting with commodity wifi. Journal on Computing and Cultural Heritage, july 2022. ISSN 1556-4673. doi: 10.1145/3530694. URL https://doi.org/10.1145/3530694. Just Accepted.Google ScholarDigital Library
- Yuji Yoshimura, Stanislav Sobolevsky, Carlo Ratti, Fabien Girardin, Juan Pablo Carrascal, Josep Blat, and Roberta Sinatra. An analysis of visitors’ behavior in the louvre museum: A study using bluetooth data. Environment and Planning B: Planning and Design, 41:1113–1131, 2014. ISSN 14723417. doi: 10.1068/b130047p. URL https://journals.sagepub.com/doi/10.1068/b130047p.Google ScholarCross Ref
- Jonathan D. L. Casano, Jenilyn L. Agapito, Abigail S. Moreno, and Ma. Mercedes T. Rodrigo. Inf-based tracking and characterization of museum visitor paths and behaviors using bluetooth low energy beacons. Journal on Computing and Cultural Heritage, 15(2), apr 2022. ISSN 1556-4673. doi: 10.1145/3474830. URL https://doi.org/10.1145/3474830.Google ScholarDigital Library
- Eyal Dim and Tsvi Kuflik. Automatic detection of social behavior of museum visitor pairs. ACM Transactions on Interactive Intelligent Systems (TiiS), 4, 11 2014. ISSN 21606463. doi: 10.1145/2662869. URL https://dl.acm.org/doi/10.1145/2662869.Google ScholarDigital Library
- Iva Vasic. Virtual museum of the civic art gallery of ascoli piceno in italy, 2022. URL https://dhekalos.it/tour/iva/pinacoteca/index.html.Google Scholar
- Lorenzo Stacchio, Claudia Scorolli, and Gustavo Marfia. Evaluating human aesthetic and emotional aspects of 3d generated content through extended reality. 2022.Google Scholar
- Elena Morotti, Lorenzo Stacchio, Lorenzo Donatiello, Marco Roccetti, Jari Tarabelli, and Gustavo Marfia. Exploiting fashion x-commerce through the empowerment of voice in the fashion virtual reality arena: Integrating voice assistant and virtual reality technologies for fashion communication. Virtual Reality, pages 1–14, 2022.Google Scholar
- Suzanne Sarraf. A survey of museums on the web: Who uses museum websites? Curator: The Museum Journal, 42:231–243, 7 1999. ISSN 2151-6952. doi: 10.1111/J.2151-6952.1999.TB01143.X. URL https://onlinelibrary.wiley.com/doi/full/10.1111/j.2151-6952.1999.tb01143.x.Google ScholarCross Ref
- Darren Peacock. Statistics, structures & satisfied customers: Using web log data to improve site performance. 2002. URL https://eric.ed.gov/?id=ED482104.Google Scholar
- Loris Barbieri, Fabio Bruno, and Maurizio Muzzupappa. Virtual museum system evaluation through user studies. Journal of Cultural Heritage, 26:101–108, 7 2017. ISSN 12962074. doi: 10.1016/J.CULHER.2017.02.005. URL https://www.sciencedirect.com/science/article/abs/pii/S1296207416303016.Google ScholarCross Ref
- Bruno Fanini and Luigi Cinque. Encoding, exchange and manipulation of captured immersive vr sessions for learning environments: the prismin framework. Applied Sciences, 10:2026, 3 2020. ISSN 2076-3417. doi: 10.3390/APP10062026. URL https://www.mdpi.com/2076-3417/10/6/2026/htmhttps://www.mdpi.com/2076-3417/10/6/2026.Google ScholarCross Ref
- Ramona Quattrini, Roberto Pierdicca, Marina Paolanti, Paolo Clini, Romina Nespeca, and Emanuele Frontoni. Digital interaction with 3d archaeological artefacts: evaluating user’s behaviours at different representation scales. Digital Applications in Archaeology and Cultural Heritage, 18, 2020. ISSN 22120548. doi: 10.1016/j.daach.2020.e00148. URL https://www.sciencedirect.com/science/article/abs/pii/S2212054819301018.Google ScholarCross Ref
- Roberto Pierdicca, Michele Sasso, Flavio Tonetto, Francesca Bonelli, Andrea Felicetti, and Marina Paolanti. Immersive insights: Virtual tour analytics system for understanding visitor behavior. volume 12980 LNCS, pages 135–155. Springer Science and Business Media Deutschland GmbH, 2021. ISBN 9783030875947. doi: 10.1007/978-3-030-87595-4_11/COVER. URL https://link.springer.com/chapter/10.1007/978-3-030-87595-4_11.Google ScholarDigital Library
- Jeremy Tzi-dong Ng, Weichen Liu, Xiao Hu, and Tzyy-Ping Jung. Evaluation of low-end virtual reality content of cultural heritage: A preliminary study with eye movement. In Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020, JCDL ’20, page 365–368, New York, NY, USA, 2020. Association for Computing Machinery. ISBN 9781450375856. doi: 10.1145/3383583.3398603. URL https://doi.org/10.1145/3383583.3398603.Google ScholarDigital Library
- David Nicholas and David Clark. Information Seeking Behaviour and Usage on a Multi-media Platform: Case Study Europeana, pages 57–78. Springer Berlin Heidelberg, Berlin, Heidelberg, 2014. ISBN 978-3-642-54812-3. doi: 10.1007/978-3-642-54812-3_6. URL https://doi.org/10.1007/978-3-642-54812-3_6.Google ScholarCross Ref
- Mafkereseb Kassahun Bekele, Roberto Pierdicca, Emanuele Frontoni, Eva Savina Malinverni, and James Gain. A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage, 11(2), mar 2018. ISSN 1556-4673. doi: 10.1145/3145534. URL https://doi.org/10.1145/3145534.Google ScholarDigital Library
- Laia Pujol, Maria Roussou, Stavrina Poulo, Olivier Balet, Maria Vayanou, and Yannis E. Ioannidis. Personalizing interactive digital storytelling in archaeological museums: the chess project. In Computer applications and quantitative methods in Archaeology (CAA), Southampton, UK, March 2012. ISBN 9789089646637. URL https://www.madgik.di.uoa.gr/sites/default/files/2018-06/caa2012_paper_final.pdf.Google Scholar
- Xiaobai Chen, Abulhair Saparov, Bill Pang, and Thomas Funkhouser. Schelling points on 3d surface meshes. ACM Trans. Graph., 31(4), july 2012. ISSN 0730-0301. doi: 10.1145/2185520.2185525. URL https://doi.org/10.1145/2185520.2185525.Google ScholarDigital Library
- Iva Vasic, Aleksandra Pauls, Adriano Mancini, Ramona Quattrini, Roberto Pierdicca, Renato Angeloni, Eva S. Malinverni, Emanuele Frontoni, Paolo Clini, and Bata Vasic. Virtualization and vice versa: A new procedural model of the reverse virtualization for the user behavior tracking in the virtual museums. In Lucio Tommaso De Paolis, Pasquale Arpaia, and Marco Sacco, editors, Lecture Notes in Computer Science, volume 13446, pages 329–340, Cham, 2022. Springer Nature Switzerland. ISBN 978-3-031-15553-6. URL https://link.springer.com/chapter/10.1007/978-3-031-15553-6_23.Google ScholarDigital Library
- Inc FingerprintJS. Fingerprintjs, 2021. URL https://github.com/fingerprintjs/fingerprintjs.Google Scholar
- Giuseppe Resta, Fabiana Dicuonzo, Evrim Karacan, and Domenico Pastore. The impact of virtual tours on museum exhibitions after the onset of covid-19 restrictions: visitor engagement and long-term perspectives. SCIRES-IT-SCIentific RESearch and Information Technology, 11(1):151–166, 2021. URL https://repository.bilkent.edu.tr/server/api/core/bitstreams/39497aab-89f7-4fba-99a8-5a7bae311193/content.Google Scholar
Index Terms
- 3VR: Vice Versa Virtual Reality Algorithm to Track and Map User Experience
Recommendations
The Interactive Design and User Experience of Virtual Museums: Case Study of the Virtual Palace Museum
Cross-Cultural Design. Applications in Learning, Arts, Cultural Heritage, Creative Industries, and Virtual RealityAbstractOne of the fundamental functions of a museum is to collect and preserve ancient cultural relics. Nowadays, some museums also undertake the roles as learning center, communication and social place, leisure center, and cultural communication center, ...
Virtual Museums: an Innovative Kind of Museum Survey
VRIC '15: Proceedings of the 2015 Virtual Reality International ConferenceVirtual Museums are seen as potentially real Museums produced on digital medium as new means of representing museal objects. Trials to classify a very rich, varied and exponentially growing production exist. They fall under the difficulty of which ...
EPANASTASIS-1821: Designing an Ιmmersive Virtual Museum for the Revival of Historical Events of the Greek Revolution
Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and ProtectionAbstractRecent technological advances have greatly affected the museum practice, introducing new and innovative technological solutions for the creation of more interactive, multisensory and experiential museum exhibitions. Virtual reality applications ...
Comments