Morgenstern et al., 2024 - Google Patents
Animatable Virtual Humans: Learning pose-dependent human representations in UV space for interactive performance synthesisMorgenstern et al., 2024
View PDF- Document ID
- 17821887872390261214
- Author
- Morgenstern W
- Bagdasarian M
- Hilsmann A
- Eisert P
- Publication year
- Publication venue
- IEEE transactions on visualization and computer graphics
External Links
Snippet
We propose a novel representation of virtual humans for highly realistic real-time animation and rendering in 3D applications. We learn pose dependent appearance and geometry from highly accurate dynamic mesh sequences obtained from state-of-the-art multiview-video …
- 241000282414 Homo sapiens 0 title abstract description 25
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/50—Lighting effects
- G06T15/60—Shadow generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding, e.g. from bit-mapped to non bit-mapped
- G06T9/001—Model-based coding, e.g. wire frame
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/08—Bandwidth reduction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/001—Texturing; Colouring; Generation of texture or colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20112—Image segmentation details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
- G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
- G06K9/00268—Feature extraction; Face representation
- G06K9/00281—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Zhao et al. | Human performance modeling and rendering via neural animated mesh | |
| Achenbach et al. | Fast generation of realistic virtual humans | |
| Remelli et al. | Drivable volumetric avatars using texel-aligned features | |
| CN113421328B (en) | Three-dimensional human body virtual reconstruction method and device | |
| US12361662B2 (en) | Point-based modeling of human clothing | |
| Habermann et al. | Hdhumans: A hybrid approach for high-fidelity digital humans | |
| Feng et al. | Learning disentangled avatars with hybrid 3d representations | |
| Zhao et al. | Havatar: High-fidelity head avatar via facial model conditioned neural radiance field | |
| Wenninger et al. | Realistic virtual humans from smartphone videos | |
| CN115298708A (en) | Multi-view Neural Human Rendering | |
| Peng et al. | Implicit neural representations with structured latent codes for human body modeling | |
| Zhi et al. | Dual-space nerf: Learning animatable avatars and scene lighting in separate spaces | |
| Morgenstern et al. | Animatable Virtual Humans: Learning pose-dependent human representations in UV space for interactive performance synthesis | |
| Hilsmann et al. | Going beyond free viewpoint: creating animatable volumetric video of human performances | |
| Kabadayi et al. | Gan-avatar: Controllable personalized gan-based human head avatar | |
| CN115951784A (en) | Dressing human body motion capture and generation method based on double nerve radiation fields | |
| Tran et al. | Voodoo xp: Expressive one-shot head reenactment for vr telepresence | |
| Eisert et al. | Volumetric video–acquisition, interaction, streaming and rendering | |
| Yang et al. | Poxture: Human posture imitation using neural texture | |
| Li et al. | Animatable and relightable gaussians for high-fidelity human avatar modeling | |
| Gan et al. | Fine-grained multi-view hand reconstruction using inverse rendering | |
| Chen et al. | TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting | |
| Yang et al. | Innovative AI techniques for photorealistic 3D clothed human reconstruction from monocular images or videos: a survey | |
| Theobalt et al. | Performance capture from multi-view video | |
| Raj et al. | DRaCoN--Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars |