For the past few months I’ve been sitting on a “visual design” concept that allows me to track progress of my health. Specifically lesions on my brain and spinal cord in relation to symptoms.

The 3D visual of the design concept was taken from Microsoft Garage Project InnerEye. An artificial intelligence tool that uses machine learning and computer vision to allow radiologists to make cancer treatment more targeted and effective.

As a medium to communicate I saw Project InnerEye as a tool for patient empowerment.

Regarding Multiple Sclerosis, lesions on the brain and spinal cord have no relationship to symptoms.

That said, I do believe visual electronic records, medical mixed reality and dimensional communication is a more effective way to communicate, empowering patients to see and interact with their health (see top left patient profile or bottom right, augmented reality patient pain diagram).

Things to consider: Business model and data. It takes a lot of data for machine learning to recognize patterns (variances in images) and create computer vision models.

Empathy and user experience. Intuitive patient know-how or affordances to navigate a new technology. How to make a complex interaction super easy, intuitive and enjoyable while being beautiful.

Long term return on investment. Small but strategic details can elevate an environment. Physicians and patients don’t always speak the same language, be it native or technical. Most people however understand symbols and images. Highlighting a problem area in a virtual red or placing an “upset” emoji face could alleviate communication insecurities.