Research

EUR 1.8 million in funds for research into 3D avatars in telemedicine

25 April 2022
German government funds AI and mixed reality project managed by University of Hamburg

The German Ministry of Education and Research has earmarked EUR 1.8 million in funds for the three-year Hybrid Interaction Systems for Maintaining Health Even in Exceptional Situations (HVIAM) managed by the University of Hamburg. The pandemic has highlighted the importance of remote medial care and the need to develop intelligent assistance systems for remote diagnostics using virtual 3D avatars. 

Artificial intelligence and mixed reality in remote diagnostics

During the project, the human intelligence of healthcare professionals will be combined with artificial intelligence (AI) and mixed reality (MR). AI-supported virtual 3D avatars of medical professionals will be generated, which can be displayed on mobile devices, 3D headsets or other MR applications. The avatars will use the sensors to record their environment as well as patient data such as blood pressure, blood glucose levels or weight in real time. Unlike previous voice assistants, the 3D avatars will be able to speak and show facial expressions and gestures to evoke familiarity among participants.

The AI-controlled avatars will be able to perform simple, routine tasks themselves. Medical experts will monitor the work of the virtual assistant later. If a patient wishes to speak to a doctor or nurse, they can arrange a real or virtual appointment through the assistant. "Patients can interact seamlessly with intelligent virtual assistants and avatars of doctors, therapists and nursing staff," said Prof. Dr. Frank Steinicke, a computer scientist at the University of Hamburg and spokesman for the joint project.

Strong Hanseatic participation

The participants include the Faculty of Computer Science at the University of Hamburg, the University Hospital Hamburg-Eppendorf, the Düsseldorf University of Applied Sciences and the Hamburg-based start-ups Sympatient and ApoqIar. The project volume amounts to EUR 2.12 million for the period 2022 to 2022, 85 per cent of which is being funded by the German government.

mb/sb/pb

Similar articles

University of Hamburg: EU Support for DNA Analysis in Real Time

European Research Council supports research into cost-effective and rapid DNA analysis – for monitoring disease

EU funding 3D printing of medicine and implants at UKE

Scientists test 3D printing and AI

Artificial intelligence in care and health sector

Start-ups pitch ideas for care of elderly - voice biomarkers, AI-assisted facial recognition and workouts

Business model: Fighting phobia in a virtual environment

SERIES (2): Hamburg's Sympatient combines VR exercises with guidance from real therapists
The Consent Management Platform (https://app.usercentrics.eu/) we use could not be loaded. This can happen if AdBlockers incorrectly block this URL. Some features such as maps, proximity search or forms, cannot be used this way. To use these features, please deactivate your AdBlocker or allow access to *.usercentrics.eu.