This work introduces a conversational virtual agent in Extended Reality that bridges real-time interaction between physicians, robotic ultrasound systems, and patients by communicating professionally with physicians while providing empathetic explanations to patients. The agent actively controls the robotic system through physician commands and integrates LLM-powered dialogue with speech processing and robotic control to enhance efficiency and accessibility.

Due to licensing issues with some third-party plugins and libraries, we are unable to share certain components on GitHub. Specifically, the following plugins used in the original paper are not included in this repository:

• Final-IK.
• SALSA LipSync Suite tool

If you require these plugins for your work, please refer to the official sources for obtaining them.

@article{song2025intelligent,
  title={Intelligent Virtual Sonographer (IVS): Enhancing Physician-Robot-Patient Communication},
  author={Song, Tianyu and Li, Feng and Bi, Yuan and Karlas, Angelos and Yousefi, Amir and Branzan, Daniela and Jiang, Zhongliang and Eck, Ulrich and Navab, Nassir},
  journal={arXiv preprint arXiv:2507.13052},
  year={2025}
}