Concept: Visual electronic health record application that tracks progress of health. In addition to the visual 3D component of the design, the application was to track real time overall wellness in relationship to lifestyle. Diet, exercise – syncing to Fitbit or Apple watch, medications and social time.
The 3D concept was taken from Microsoft Garage Project Innereye Eye. An artificial intelligence tool that uses machine learning and computer vision to allow radiologists to make cancer treatment more targeted and effective.
Case Example: Visual ability to monitor Multiple Sclerosis lesions on brain and spinal cord in relationship to physical symptoms. Loss of motor control in right leg, for example, or change of vision in the right eye in relationship to areas of the brain responsible for those functions.
Conclusion: Regarding Multiple Sclerosis, lesions on the brain and spinal cord have no relationship to symptoms.
That said, visual electronic records, medical mixed reality and dimensional communication is a more effective way to communicate, empowering patients to see and interact with their health (see bottom right, patient pain diagram).
Things to consider: Business model and data. It takes a lot of data for machine learning to recognize patterns (variances in images) and create a computer vision model.
Additionally, empathy and user experience. Intuitive patient know-how or affordances to navigate a new technology. How to make a complex interaction super easy, intuitive and enjoyable while being beautiful.
Findings: Small but strategic details can elevate an environment. Physicians and patients don’t always speak the first same language be it native or technical. Most people however understand symbols and images. Highlighting a problem area in a virtual red or placing an upset emoji face could alleviate communication insecurities.