<p><strong><span class="legendSpanClass"><span class="xn-location">SUNNYVALE</span></span></strong> &#8212; Google Cloud has announced new generative AI (gen AI) capabilities in Vertex AI Search for healthcare, including a new feature called Visual Q&;A that searches tables, charts, and diagrams, and the availability of Gemini 2.0 as one of the models now within the offering. Vertex AI Search for healthcare&#8217;s new, multimodal search capabilities can help organizations give doctors, nurses, and others a more comprehensive view of patient health.</p>
<p>&#8220;We&#8217;re helping clinicians to work more efficiently with new multimodal capabilities embedded in Vertex AI Search for healthcare,&#8221; said <span class="xn-person">Aashima Gupta</span>, global director of Healthcare Strategy &; Solutions, Google Cloud. &#8220;Multimodal analysis processes diverse sources of patient data, like medical images and genetic information, for a more comprehensive understanding and improved decision-making.&#8221;</p>
<p><b>Multimodal AI: A comprehensive view of patient health<br class="dnr" /></b>Multimodal AI refers to technology that is capable of processing and integrating information from diverse sources – such as images, videos, and text. This capability is especially important in healthcare, where nearly <u><a href="https://c212.net/c/link/?t=0&;l=en&;o=4371381-1&;h=4147391257&;u=https%3A%2F%2Fpmc.ncbi.nlm.nih.gov%2Farticles%2FPMC10544772%2F&;a=90%25+of+healthcare+data" target="_blank" rel="nofollow noopener">90% of healthcare data</a></u> is in image form – such as x-rays, scans, or photos. To give healthcare professionals a comprehensive understanding of a patient&#8217;s health, AI models can combine data from medical images, patient history, genetic information, and more. With these richer data inputs, multimodal AI can help providers in making more accurate diagnoses, designing more personalized treatment plans, and ultimately improving patient outcomes.</p>
<p><b>Vertex AI Search for healthcare goes multimodal<br class="dnr" /></b>Vertex AI Search for healthcare is a specialized tool within Google Cloud&#8217;s Vertex AI platform that helps developers build better assistive technology for searching and retrieving information from complex medical data within health records, medical documents, and other healthcare data sources. Now with Visual Q&;A and Gemini 2.0, the search technology has even greater capabilities:</p>
<ul >
<li><b>Visual Q&;A</b> enables Vertex AI Search for healthcare to receive images such as tables, charts, or diagrams directly as an input – instead of taking the image and first converting it into text. For example, it could receive a diagram of a patient&#8217;s feet indicating where they have an injury, alongside a checkbox from a form the patient filled out indicating if they are wearing therapeutic shoes, and any other symptoms indicated on the form. Visual Q&;A can also analyze medical forms where information is entered into tables – and when this information is a relevant part of a search, it will include it in the findings for the clinician.</li>
<li><b>Gemini 2.0 </b>helps Vertex AI Search for healthcare deliver faster, more accurate answers. For example, <u><a href="https://c212.net/c/link/?t=0&;l=en&;o=4371381-1&;h=1695593840&;u=https%3A%2F%2Fblog.google%2Ftechnology%2Fgoogle-deepmind%2Fgoogle-gemini-ai-update-december-2024%2F%23ceo-message&;a=Gemini+2.0+Flash+outperforms+1.5+Pro+on+key+benchmarks%2C+at+twice+the+speed" target="_blank" rel="nofollow noopener">Gemini 2.0 Flash outperforms 1.5 Pro on key benchmarks, at twice the speed</a></u>. This performance boost accelerates the retrieval and processing of multimodal data, including visual medical content like charts, tables, and images, enabling faster, more informed decision-making.</li>
</ul>
<p><b>Counterpart Health<br class="dnr" /></b>Counterpart Health is an AI-powered physician enablement company focused on advancing value-based care through earlier identification and proactive management of chronic disease. The company&#8217;s proprietary technology platform, Counterpart Assistant, delivers real-time, patient-specific insights directly within physicians&#8217; workflows, ensuring clinical decisions are guided by actionable data that lead to better patient outcomes. Counterpart Health is a subsidiary of Clover Health Investments, Corp.</p>
<p>&#8220;Counterpart Health is dedicated to helping clinicians deliver the highest quality of care to their patients,&#8221; said <span class="xn-person">David Tsay</span>, MD, chief medical officer at Counterpart Health. &#8220;The advancements in Vertex AI Search for healthcare provide us with powerful new tools to achieve these goals. Multimodal AI capabilities will enable clinicians to integrate diverse types of clinical data sources, providing a more comprehensive understanding of their patients&#8217; health and facilitating personalized care management.&#8221;</p>
<p><b>MEDITECH<br class="dnr" /></b>Global electronic medical record company <u><a href="https://c212.net/c/link/?t=0&;l=en&;o=4371381-1&;h=2939205007&;u=https%3A%2F%2Fehr.meditech.com%2Fehr-solutions%2Fexpanse-artificial-intelligence&;a=MEDITECH+has+developed+an+AI-powered+search+and+" target="_blank" rel="nofollow noopener">MEDITECH has developed an AI-powered search and </a><a href="https://c212.net/c/link/?t=0&;l=en&;o=4371381-1&;h=2991628848&;u=https%3A%2F%2Fehr.meditech.com%2Fehr-solutions%2Fexpanse-artificial-intelligence&;a=summarization" target="_blank" rel="nofollow noopener">summarization</a></u> capability in its Expanse EHR to enable care teams to find the information they need using Google&#8217;s familiar search function and gen AI. The new features announced today will further advance its EHR capabilities.</p>
<p>&#8220;MEDITECH&#8217;s collaboration with Google Cloud will bring the latest advancements in multimodal AI to our Expanse EHR,&#8221; said <span class="xn-person">Cathy Turner</span>, Chief Marketing and Nursing Executive, MEDITECH. &#8220;Building on our successful work with Google Cloud in developing AI-powered search and summarization, these advancements will further enhance our ability to deliver cutting-edge tools that empower clinicians and improve workflows.&#8221;</p>
<p><b>Suki<br class="dnr" /></b><u><a href="https://c212.net/c/link/?t=0&;l=en&;o=4371381-1&;h=4046594398&;u=https%3A%2F%2Fwww.businesswire.com%2Fnews%2Fhome%2F20241218566553%2Fen%2FSuki-Launches-Patient-Summarization-and-Clinical-QA-for-Doctors-With-Google-Cloud&;a=Suki+recently+announced" target="_blank" rel="nofollow noopener">Suki recently announced</a></u> its Suki Assistant now includes patient summarization and clinical Q&;A for clinicians, built on Google Cloud technology. These features help users quickly and easily find information needed to make care decisions, freeing up clinicians so they can focus on their patients.</p>
<p>&#8220;Google Cloud is continuing to push the boundaries of what&#8217;s possible with multimodal AI in healthcare,&#8221; said <span class="xn-person">Punit Soni</span>, founder and CEO of Suki. &#8220;The advancements in Vertex AI Search for healthcare complement Suki&#8217;s mission to make healthcare technology invisible and assistive. By combining Suki&#8217;s expertise in ambient AI with Google Cloud&#8217;s powerful multimodal capabilities, we are equipping clinicians with instant access to the critical information they need, enabling them to deliver the best possible patient care.&#8221;</p>

SAN FRANCISCO -- Wispr, the voice-to-text AI that turns speech into clear, polished writing in every…
SAN FRANCISCO -- Numeric, an AI accounting automation platform, has raised a $51 million Series…
Apple has announced 45 finalists for this year’s App Store Awards, recognizing the best apps…
The University of California (UC) and the California Nurses Association (CNA) have reached a tentative…
SAN FRANCISCO -- House Rx, a health tech company focused on making specialty medications more accessible and…
Britain's King has given an award to the King of NVIDIA! NVIDIA founder and CEO…