Skyba et al., 2024 - Google Patents
Towards natural language understanding for intuitive interactions in XR using large language modelsSkyba et al., 2024
View PDF- Document ID
- 1189077370959326252
- Author
- Skyba K
- Pfeiffer T
- Publication year
- Publication venue
- GI VR/AR Workshop
External Links
Snippet
This paper presents a voice assistance system for extended reality (XR) applications based on large language models (LLMs). The aim is to create an intuitive and natural interface between users and virtual environments that goes beyond traditional, predefined voice …
- 230000003993 interaction 0 title abstract description 42
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computer systems utilising knowledge based models
- G06N5/02—Knowledge representation
- G06N5/022—Knowledge engineering, knowledge acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computer systems utilising knowledge based models
- G06N5/04—Inference methods or devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/004—Artificial life, i.e. computers simulating life
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N99/00—Subject matter not provided for in other groups of this subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation, e.g. computer aided management of electronic mail or groupware; Time management, e.g. calendars, reminders, meetings or time accounting
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Alexandrova et al. | RoboFlow: A flow-based visual programming language for mobile manipulation tasks | |
| Gabbard | A taxonomy of usability characteristics in virtual environments | |
| Cheyer et al. | The open agent architecture | |
| Bradshaw | An introduction to software agents | |
| Rybski et al. | Interactive robot task training through dialog and demonstration | |
| Lee | A survey of robot learning from demonstrations for human-robot collaboration | |
| Maher et al. | Agent models of 3D virtual worlds | |
| Thórisson et al. | Constructionist design methodology for interactive intelligences | |
| Toy et al. | Metacognition is all you need? using introspection in generative agents to improve goal-directed behavior | |
| Inamura et al. | SIGVerse: A cloud-based VR platform for research on social and embodied human-robot interaction | |
| Mumuni et al. | Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches | |
| Deichler et al. | Learning to generate pointing gestures in situated embodied conversational agents | |
| Pandey et al. | Towards human-level semantics understanding of human-centered object manipulation tasks for HRI: reasoning about effect, ability, effort and perspective taking | |
| Scherf et al. | Interactively learning behavior trees from imperfect human demonstrations | |
| Lin et al. | Advances in embodied navigation using large language models: A survey | |
| Skyba et al. | Towards natural language understanding for intuitive interactions in XR using large language models | |
| Young et al. | Style by demonstration: teaching interactive movement style to robots | |
| Poulakos et al. | Towards an accessible interface for story world building | |
| Brachman et al. | Integrated AI systems | |
| Li et al. | Virtual humans: Evolving with common sense | |
| Frijns et al. | Programming robot animation through human body movement | |
| Braunschweiler et al. | A Two-Level Planning Framework for Mixed Reality Interactive Narratives with User Engagement | |
| Yuan et al. | Embodied tour guide in an interactive virtual art gallery | |
| Fazzari et al. | PRISME: Toward a model linking tangible interaction and domain-specific tasks in mixed reality environments | |
| Wu | Multimodal Communication for Embodied Human-Robot Interaction with Natural Gestures |