• About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy
Tech Chilli
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
Tech Chilli
No Result
View All Result

Home » News » Microsoft Unveils Phi-3.5 AI Model Family: Advanced MoE, Vision, and Mini Models Now Available

Microsoft Unveils Phi-3.5 AI Model Family: Advanced MoE, Vision, and Mini Models Now Available

Microsoft has introduced the Phi-3.5 AI model family, featuring the new MoE, Vision, and Mini models. These advanced AI tools, now available on Hugging Face, offer significant improvements in language and image processing, making them ideal for sophisticated AI applications.

Kumud Sahni Pruthi by Kumud Sahni Pruthi
Thursday, 22 August 2024, 21:32 PM
in News
Microsoft Unveils Phi-3.5 AI Model

Microsoft Unveils Phi-3.5 AI Model

On Tuesday, Microsoft unveiled the Phi-3.5 artificial intelligence (AI) model family, which is the follow-up to the Phi-3 models unveiled in April. The Phi-3.5 Mixture of Experts (MoE), Phi-3.5 Vision, and Phi-3.5 Mini models are included in the latest edition. Because these are instructed models, users will need to provide explicit instructions for them to function as regular conversational AI and produce the necessary results. You can download the open-source AI models from the tech giant’s Hugging Face listings.

Weizhu Chen, a Microsoft executive, revealed the availability of the new AI models in a post on X (previously known as Twitter). The Phi-3.5 models are more capable than their predecessors, although they still use the same architecture, dataset, and training techniques. The AI model family now includes the MoE and Vision models in addition to the revised Mini model with language capability.

We released phi 3.5: mini+MoE+vision

A better mini model with multilingual support: https://t.co/f7avhBXHYn

A new MoE model:https://t.co/FxLILAqpEr

A new vision model supporting multiple images: https://t.co/rMkkpFc4cx

— Weizhu Chen (@WeizhuChen) August 20, 2024

Also Read: Microsoft AI Tour 2024: Who and Why Should Attend? Find your city for Speakers and Sessions

Technical details: there are 3.8 billion parameters on the Phi-3.5 Mini. It makes use of a dense decoder-only transformer and the same tokenizer, a tool for segmenting text into smaller pieces. The model accepts a context window of 1,28,000 tokens and only accepts text as input. According to the business, between June and August, 3.4 trillion tokens were used to train it. The knowledge cut-off date is October 2023.

Arabic, Chinese, Czech, Danish, Dutch, English, Finnish, French, German, Hebrew, Hungarian, Italian, Japanese, Korean, Norwegian, Polish, Portuguese, Russian, Spanish, Swedish, Thai, Turkish, and Ukrainian are just a few of the many new languages that this model now supports.

With 4.2 billion parameters, the Phi-3.5 Vision AI model can process information contained in images thanks to an image encoder. It takes images and text with the same context length as the Mini model as input. Its text knowledge cutoff date is March, and it was trained on 500 billion tokens of data between July and August.

Lastly, there are 16×3.8 billion parameters in the Phi-3.5 MoE AI model. But when two experts are used, just 6.6 billion of them become active parameters. Notably, MoE is a technique that enhances the accuracy and efficiency of the model by training multiple models (experts) individually and then combining them. This model has an October 2023 knowledge cutoff date and was trained on 4.9 trillion tokens of data between April and August.

Microsoft released the benchmark scores for each model. The Phi-3.5 MoE beats the Gemini 1.5 Flash and GPT-4o small in the SQuALITY benchmark, which evaluates readability and accuracy in summarizing lengthy text passages. This evaluates the AI model’s extended context window.

It should be noted, though, that this is not a fair comparison because MoE models have a different design and need more advanced technology and storage to function. In addition, the Phi-3.5 Mini and Vision models have surpassed pertinent rival AI models in the same market sector in a few different measures.

Also Read: Microsoft Designer App: How to Use the AI Image Generator Tool for Editing and Creation?

Hugging Face listings provide access to the Phi-3.5 AI models for those who would like to test them out. According to Microsoft, consumers running these devices will need to use sophisticated GPUs because they use flash attention. Utilizing GPUs from Nvidia A100, A6000, and H100, the company has evaluated them.

Previous Post

Bhavish Aggarwal Net Worth: CEO of Ola Cabs, Founder of OlaKrutrim and Ola Electric

Next Post

PhonePe Launches Instant UPI Credit Line Feature: Revolutionizing Digital Payments in India

Kumud Sahni Pruthi

Kumud Sahni Pruthi

A postgraduate in Science with an inclination towards education and technology. She always looks for ways to help people improve their lives by putting complex things into simple words through her writing.

Next Post
PhonePe Leads UPI Market in August 2024, Claims 50% Share by Value and 48% by Volume

PhonePe Launches Instant UPI Credit Line Feature: Revolutionizing Digital Payments in India

  • Trending
  • Comments
  • Latest
top Yield Farming Platforms

Top 13 Yield Farming Platforms in 2025: Maximize APY with Secure and Trusted Crypto Tools

April 17, 2025
scott wu net worth

Scott Wu Net Worth: Devin AI Software Engineer, CEO of Cognition Labs

April 17, 2025
Artificial Intelligence (AI) Glossary and Terminologies

Artificial Intelligence (AI) Glossary and Terminologies – Complete Cheat Sheet List

April 18, 2025
TurbolearnAI

Turbolearn AI: How to Use It for FREE, Features and Pricing Models

April 3, 2025
What is Blockchain Technology

What is Blockchain Technology And How Does It Work?

Enterprise AI

What is Enterprise AI? Meaning, Companies, Examples and More Details

Cosine Genie AI Software Engineer

What is Cosine Genie and How to Use? Check Benchmark, Functions, and Access Details

PhonePe Leads UPI Market in August 2024, Claims 50% Share by Value and 48% by Volume

PhonePe Partners with Liquid Group to Bring UPI Payments to Singapore for Indian Travelers

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025

Recent News

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025

Trending in AI

  • Perplexity CEO Net Worth
  • Grammarly AI Detection
  • What is LangChain
  • Canva AI Tool
  • Koupon AI
Tech Chilli

Tech Chilli is a beacon of knowledge, a relentless purveyor of the latest information, news, and groundbreaking research in the realm of cutting-edge technology.

We are dedicated to curating and delivering the most relevant, accurate, and up-to-the-minute information on the technologies that are shaping our world.
Contact us – [email protected]

Follow Us

Browse by Category

  • AI
  • AI India
  • Courses
  • Crypto
  • Featured
  • FinTech
  • Gaming
  • How-To
  • News
  • Puzzles
  • Robotics

Top Searches

  • Scott Wu Net Worth
  • Mira Murati Net Worth
  • Online Games for Couples
  • Amazon Q vs Microsoft Copilot
  • DarkGPT

Recent News

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025
  • About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy

© 2024 Tech Chilli

No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us

© 2024 Tech Chilli

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.OK