Jivi Outperforms OpenAI in the Medical Language Modeling Challenge

Jivi, an Indian healthcare AI startup, has achieved a major milestone in the field of medical language models (LLMs). The company’s purpose-built medical LLM, Jivi MedX, has ranked number 1 on the Open Medical LLM Leaderboard, beating established LLMs such as OpenAI’s GPT-4 and Google’s Med-PaLM 2 with an average score of 91.65 across leaderboards. 

The Medical LLM was built by Jivi, which is an Indian Startup and co-founded by Ankur Jain, former BharatPe Product Officer.  It was founded in January 2024 with a small team of doctors, surgeons, etc. Now it has extended to a wider scope by working on new technology implementing LLM in the medical field and thus making the Indian healthcare system more accessible and affordable.

Open Medical LLM Leaderboard:

The Open Medical LLM Leaderboard is a platform that ranks medical-specific LLMs based on their performance in answering medical questions from exams and research. Hosted by leading AI platform Hugging Face, the University of Edinburgh, and Open Life Science AI, the leaderboard covers medical exams such as Indian medical entrance exams (AIIMS and NEET), US Medical License Exams (USMLE), and detailed assessments in clinical knowledge, medical genetics, and professional medicine, among others.

Jivi MedX:

Jivi’s LLM, Jivi MedX, achieved an average score of 91.65 across the leaderboard’s nine benchmark categories. The company uses its large proprietary medical dataset consisting of millions of medical research papers, journals, clinical notes, and other sources to train its LLM. This dataset is among the largest in the world. Jivi MedX was trained using an instruction fine-tuning algorithm called Odds Ratio Preference Optimisation (ORPO).

Also Read: How Nvidia Powered Hippocratic AI Solves Global Healthcare Staff Shortage with AI Nurses for $9 per hour

Jivi’s Mission:

Jivi was co-founded by former BharatPe Chief Product Officer Ankur Jain and GV Sanjay Reddy, Chairman, of Reddy Ventures. The company currently operates with a lean, 20-member team of physicians, surgeons, AI engineers, and data scientists. Jivi is developing technology to transform accessibility, affordability, and quality of healthcare globally.

Ankur Jain, Co-founder and CEO, of JIVI, said “Jivi is revolutionizing primary healthcare through generative AI, making top-quality care accessible 24/7 at a fraction of the cost. Our mission at Jivi is to harness artificial intelligence to enhance patient care. Our platform accelerates diagnostics and ensures higher accuracy, enabling timely and precise treatment for all,”

Jivi’s achievement in the Open Medical LLM Leaderboard is a testament to the company’s innovative approach to healthcare AI. The company’s purpose-built medical LLM, Jivi MedX, has the potential to revolutionize the way medical information is processed and accessed, ultimately improving patient outcomes.

Also Read: Google’s Med-Gemini AI: A Leap Beyond GPT-4 in Medical Innovation