• About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy
Tech Chilli
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
Tech Chilli
No Result
View All Result

Home » News » Meta AI Introduces Pixel Transformers for Enhanced Computer Vision

Meta AI Introduces Pixel Transformers for Enhanced Computer Vision

Meta AI and the University of Amsterdam unveil Pixel Transformers, a groundbreaking neural network architecture that treats individual pixels as tokens, outperforming traditional models in various computer vision tasks.

Kumud Sahni Pruthi by Kumud Sahni Pruthi
Monday, 17 June 2024, 23:40 PM
in News
Pixel Transformers by Meta AI: Revolutionizing Image Processing

Pixel Transformers by Meta AI: Revolutionizing Image Processing

In Short

  • Innovative Architecture: Pixel Transformers (PiTs) by Meta AI and the University of Amsterdam treat individual pixels as tokens, eliminating the need for locality bias in image processing.
  • Superior Performance: PiTs demonstrate exceptional results in image generation, object categorization, and self-supervised learning, outperforming traditional models.
  • Research Implications: Despite higher computational complexity, PiTs challenge the conventional patch-based approach, paving the way for advanced computer vision technologies.

According to recent research from Meta AI and the University of Amsterdam, transformers are a common neural network architecture that can work directly on individual pixels in an image without depending on the locality inductive bias found in most contemporary computer vision models.

Vanilla Transformers are capable of producing extremely performant outcomes by treating every single pixel as a token in their operations. This design differs significantly from the widely used one in Vision Transformer, which treats each 16×16 patch as a token and preserves the inductive bias from ConvNets towards local neighbourhoods. 

The efficiency of using pixels as tokens in three well-researched computer vision tasks: creating images using diffusion models, supervised learning for object categorization, and self-supervised learning through masked autoencoding. 

Even if it is less computationally viable to manipulate individual pixels directly, researchers believe that the community should be aware of this surprising discovery to develop the next generation of computer vision neural networks.

The introduction of Pixel Transformers (PiTs) by researchers eliminated any presumptions regarding the 2D grid layout of images by treating each pixel as a separate token. Remarkably, PiTs performed remarkably well in a variety of activities.

Also Read: Apple Unveils ‘Apple Intelligence’ AI, Limited Developer Access This Summer

PiTs followed the Diffusion Transformers (DiTs) architecture and fared better than their locality-biased equivalents in quality metrics like Fréchet Inception Distance (FID) and Inception Score (IS) while operating on latent token spaces from VQGAN.

As per the research, the coverage and usefulness are still constrained, though. Because of the quadratic computation complexity, PiT is more of an investigative technique than an application-specific one.

However, we think this study has made it very evident—unfiltered—that pacification is just a helpful heuristic that compromises accuracy for performance and that locality is not essential.

Also Read: Oracle’s Initiative to Train 200,000 Indians in AI, Data Science, and Cloud

Previous Post

Finding Words Puzzle: Only eagle eyed readers can find the word APRIL in 7 seconds!

Next Post

Join JMI’s AI & ML Training Program: 3 Weeks, Online & Offline, Starts July 1, 2024

Kumud Sahni Pruthi

Kumud Sahni Pruthi

A postgraduate in Science with an inclination towards education and technology. She always looks for ways to help people improve their lives by putting complex things into simple words through her writing.

Next Post
JMI Launches Hybrid AI & ML Course: 50-Hour Training Begins July 1, 2024

Join JMI's AI & ML Training Program: 3 Weeks, Online & Offline, Starts July 1, 2024

  • Trending
  • Comments
  • Latest
top Yield Farming Platforms

Top 13 Yield Farming Platforms in 2025: Maximize APY with Secure and Trusted Crypto Tools

April 17, 2025
scott wu net worth

Scott Wu Net Worth: Devin AI Software Engineer, CEO of Cognition Labs

April 17, 2025
Artificial Intelligence (AI) Glossary and Terminologies

Artificial Intelligence (AI) Glossary and Terminologies – Complete Cheat Sheet List

April 18, 2025
TurbolearnAI

Turbolearn AI: How to Use It for FREE, Features and Pricing Models

April 3, 2025
What is Blockchain Technology

What is Blockchain Technology And How Does It Work?

Enterprise AI

What is Enterprise AI? Meaning, Companies, Examples and More Details

Cosine Genie AI Software Engineer

What is Cosine Genie and How to Use? Check Benchmark, Functions, and Access Details

PhonePe Leads UPI Market in August 2024, Claims 50% Share by Value and 48% by Volume

PhonePe Partners with Liquid Group to Bring UPI Payments to Singapore for Indian Travelers

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025

Recent News

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025

Trending in AI

  • Perplexity CEO Net Worth
  • Grammarly AI Detection
  • What is LangChain
  • Canva AI Tool
  • Koupon AI
Tech Chilli

Tech Chilli is a beacon of knowledge, a relentless purveyor of the latest information, news, and groundbreaking research in the realm of cutting-edge technology.

We are dedicated to curating and delivering the most relevant, accurate, and up-to-the-minute information on the technologies that are shaping our world.
Contact us – [email protected]

Follow Us

Browse by Category

  • AI
  • AI India
  • Courses
  • Crypto
  • Featured
  • FinTech
  • Gaming
  • How-To
  • News
  • Puzzles
  • Robotics

Top Searches

  • Scott Wu Net Worth
  • Mira Murati Net Worth
  • Online Games for Couples
  • Amazon Q vs Microsoft Copilot
  • DarkGPT

Recent News

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025
  • About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy

© 2024 Tech Chilli

No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us

© 2024 Tech Chilli

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.OK