Abstract
This paper is concerned with pragmatic problems at the cutting edge of annotation management and placement of information in immersive environments. Annotations are ancillary information that might play an essential role during the exploration of a virtual environment, helping users articulate insights and share knowledge. The challenge relies on efficiently exploring the annotations within the virtual environment. On the one hand, displaying all annotations at once might be a nuisance due to the cluttering of objects in the scene. On the other hand, inspecting all objects in the scene to see whether (or not) they contain annotations could be an exhausting task. In order to investigate the information placement of annotations in virtual environments, we have developed a tool support called WristNotes and we investigate the use of this tool in terms of user experience and usability. WristNotes allows wrist-mounted and mid-air placements for annotation controls. We also present the results of a preliminary study with 12 participants in which we examine the impact of information placement. Our findings showed that WristNotes is suitable for performing search and locate tasks, regardless of the placement strategy (mid-air or wrist-mounted). Moreover, the flexibility for information placement of annotations as implemented by WristNote was appreciated by users, while keeping cognitive load scores to a minimum.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
In order to simplify the description of the system and focus on the placement of information, we do not present the tasks for creating annotations.
- 4.
References
Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: An introduction to 3-D user interface design. Presence 10(1), 96–108 (2001)
Bowman, D.A., North, C., Chen, J., Polys, N.F., Pyla, P.S., Yilmaz, U.: Information-rich virtual environments: theory, tools, and research agenda. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 81–90. VRST ’03, Association for Computing Machinery, New York, NY, USA (2003). https://doi.org/10.1145/1008653.1008669
CEREMA: Enquête ménages déplacements, grenoble / grande région grenobloise (emd, grenoble / grande région grenobloise). Syndicat mixte des transports en commun de l’agglomération grenobloise (producteurs), ADISP (diffuseur) (2010)
Das, K., Borst, C.W.: An evaluation of menu properties and pointing techniques in a projection-based VR environment. In: 2010 IEEE Symposium on 3D User Interfaces (3DUI). IEEE (2010)
Davari, S., Bowman, D.A.: Towards context-aware adaptation in extended reality: a design space for XR interfaces and an adaptive placement strategy. arXiv [cs.HC] (2024)
Duver, M., Wiederhold, N., Kyrarini, M., Banerjee, S., Banerjee, N.K.: VR-hand-in-hand: using virtual reality (VR) hand tracking for hand-object data annotation. In: 2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR). IEEE (2024)
Feld, N., Zielasko, D., Weyers, B.: Effects of hand occlusion in radial mid-air menu interaction in augmented reality. In: 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE (2024)
Grubert, J., Langlotz, T., Zollmann, S., Regenbrecht, H.: Towards pervasive augmented reality: context-awareness in augmented reality. IEEE Trans. Vis. Comput. Graph. 23(6), 1706–1724 (2017)
Hart, S.G.: Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proc. Hum. Fact. Ergonom. Soc. Annual Meet. 50(9), 904–908 (2006). https://doi.org/10.1177/154193120605000909, http://pro.sagepub.com/content/50/9/904.abstract, iSBN: 1071-1813
Imamov, S., Monzel, D., Lages, W.S.: Where to display? How interface position affects comfort and task switching time on glanceable interfaces. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 851–858 (2020)
Jannat, M.E., Dhaka, P., Katsuragawa, K., Hasan, K.: Exploring augmented reality user interface transitions across mid-air, on-body and physical surfaces. In: 2024 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 1177–1186. IEEE (2024)
Kennedy, R.S., Lane, N.E., Kevin, S., Lilienthal, M.G.: An enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3(3), 203–220 (1993). https://doi.org/10.1207/s15327108ijap0303
Lages, W.S., Bowman, D.A.: Walking with adaptive augmented reality workspaces: design and usage patterns. In: Proceedings of the 24th International Conference on Intelligent User Interfaces, pp. 356–366. IUI ’19, Association for Computing Machinery, New York, NY, USA (2019)
Laine, J., Rastas, E., Seitamaa, A., Hakkarainen, K., Korhonen, T.: Immersive virtual reality for complex skills training: content analysis of experienced challenges. Virt. Reality 28(1), 61 (2024). https://doi.org/10.1007/s10055-024-00955-8
Laviola, Jr, J.J., Kruijff, E., McMahan, R.P.: 3D User Interfaces. Addison-Wesley Professional, 2 Edn. (2017)
Lee, B., Sedlmair, M., Schmalstieg, D.: Design patterns for situated visualization in augmented reality. IEEE Trans. Vis. Comput. Graph. 30(1), 1324–1335 (2024)
Li, X., et al.: Investigating creation perspectives and icon placement preferences for on-body menus in virtual reality. Proc. ACM Hum. Comput. Interact. 8(ISS), 236–254 (2024)
Lindlbauer, D., Feit, A.M., Hilliges, O.: Context-aware online adaptation of mixed reality interfaces. In: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 147–160. UIST ’19, Association for Computing Machinery, New York, NY, USA (2019)
Liu, J., Prouzeau, A., Ens, B., Dwyer, T.: Effects of display layout on spatial memory for immersive environments. Proc. ACM Hum.-Comput. Interact. 6(ISS), 468–488 (2022)
Lu, F., Bowman, D.A.: Evaluating the potential of glanceable AR interfaces for authentic everyday uses. In: 2021 IEEE Virtual Reality and 3D User Interfaces (VR), pp. 768–777 (2021)
Lu, F., Xu, Y.: Exploring spatial UI transition mechanisms with head-worn augmented reality. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–16. No. Article 550 in CHI ’22, Association for Computing Machinery, New York, NY, USA (2022)
Luo, W., Lehmann, A., Widengren, H., Dachselt, R.: Where should we put it? Layout and placement strategies of documents in augmented reality for collaborative sensemaking. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–16. No. Article 627 in CHI ’22, Association for Computing Machinery, New York, NY, USA (2022)
Mark S. Young, Karel A. Brookhuis, C.D.W., Hancock, P.A.: State of science: mental workload in ergonomics. Ergonomics 58(1), 1–17 (2015). https://doi.org/10.1080/00140139.2014.956151
Pei, S., Kim, D., Olwal, A., Zhang, Y., Du, R.: UI mobility control in XR: switching UI positionings between static, dynamic, and self entities. In: Proceedings of the CHI Conference on Human Factors in Computing Systems, pp. 1–12. ACM, New York, NY, USA (2024)
Radianti, J., Majchrzak, T.A., Fromm, J., Wohlgenannt, I.: A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Comput. Educ. 147, 103778 (2020). https://doi.org/10.1016/j.compedu.2019.103778, https://www.sciencedirect.com/science/article/pii/S0360131519303276
Roberts, J.C.: State of the art: coordinated and multiple views in exploratory visualization. In: Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007), pp. 61–71 (2007). https://doi.org/10.1109/CMV.2007.20
Shin, S., Batch, A., Butcher, P.W.S., Ritsos, P.D., Elmqvist, N.: The Reality of the Situation: A Survey of Situated Analytics. IEEE Trans. Vis. Comput. Graph (2023)
Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings 1996 IEEE Symposium on Visual Languages, pp. 336–343 (1996). https://doi.org/10.1109/VL.1996.545307
Strojny, P., Dużmańska-Misiarczyk, N.: Measuring the effectiveness of virtual training: a systematic review. Comput. Educ. X Reality 2, 100006 (2023). https://doi.org/10.1016/j.cexr.2022.100006, https://www.sciencedirect.com/science/article/pii/S294967802200006X
Vertegaal, R.: Attentive user interfaces. Commun. ACM 46(3), 30–33 (2003)
Wentzel, J., Lakier, M., Hartmann, J., Shazib, F., Casiez, G., Vogel, D.: A comparison of virtual reality menu archetypes: Raycasting, direct input, and marking menus. IEEE Trans. Vis. Comput. Graph. PP, 1–15 (2024)
White, S., Feiner, S.: SiteLens. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA (2009)
Willett, W., Jansen, Y., Dragicevic, P.: Embedded data representations. IEEE Trans. Vis. Comput. Graph. 23(1), 461–470 (2017)
Zhang, Y., Wang, Z., Zhang, J., Shan, G., Tian, D.: A survey of immersive visualization: focus on perception and interaction. Vis. Info. 7(4), 22–35 (2023). https://doi.org/10.1016/j.visinf.2023.10.003, https://www.sciencedirect.com/science/article/pii/S2468502X23000499
Acnowledgements
This work was supported by the project 5G for Metropolis, Local and Regional Authorities (Project 101181316), co-funded by the European Union.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2026 IFIP International Federation for Information Processing
About this paper
Cite this paper
Quere, C. et al. (2026). WristNotes: Detachable Menu for Annotations in Immersive Environments. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2025. INTERACT 2025. Lecture Notes in Computer Science, vol 16110. Springer, Cham. https://doi.org/10.1007/978-3-032-05005-2_29
Download citation
DOI: https://doi.org/10.1007/978-3-032-05005-2_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-032-05004-5
Online ISBN: 978-3-032-05005-2
eBook Packages: Computer ScienceComputer Science (R0)