• About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy
Tech Chilli
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
Tech Chilli
No Result
View All Result

Home » News » Nightshade: Artists’ New Tool to “Poison” AI Models with Corrupted Training Data

Nightshade: Artists’ New Tool to “Poison” AI Models with Corrupted Training Data

Nightshade represents a significant step in the ongoing battle between artists and AI companies over the use of creative work as training data. By allowing artists to subtly "poison" AI models with corrupted training data, Nightshade offers a promising tool for protecting artists' rights and intellectual property.

francoise hardy by Françoise
Tuesday, 24 October 2023, 14:09 PM
in AI, News
AI Project Ideas

AI Project Ideas

In the rapidly evolving era of generative AI, artists, entertainers, and performers are stepping up their opposition against AI companies that use their creations for training data without their consent. This practice has prompted several lawsuits, some directed at OpenAI, the creator of ChatGPT. Central to these grievances is the extensive use of multimedia data, including written and visual content produced by artists, to train commercial AI products.

One practice that has stirred controversy is the scraping of material from the internet for training datasets. Initially embraced by artists for indexing their work for search results, it is now met with opposition due to AI’s ability to generate competing content. However, artists are not merely resorting to legal action; they are taking a proactive approach by harnessing technology to protect their work. One such solution is Nightshade, an open-source tool still in development.

Nightshade: Artists' New Tool to "Poison" AI Models
MIT Technology Review

Nightshade was developed by researchers at the University of Chicago, led by computer science professor Ben Zhao. It serves as an optional feature for Glaze, another online tool that cloaks digital artwork and subtly alters its pixels to confound AI models regarding its style. Nightshade takes the counterattack a step further by causing AI models to learn incorrect labels for the objects and scenes in images.

By now, I'm guessing most have already seen the news on our new project, Nightshade. Lots of artists sharing it, but here's the article from MIT Technology Review (thank you to the wonderful @Melissahei), and a thread explaining its goals and design. https://t.co/N01ThDT5r7

— Glaze at UChicago (@TheGlazeProject) October 24, 2023

For instance, Nightshade can make an image of a dog appear as a cat to an AI model. After learning from just 50 such manipulated images, the AI starts producing bizarre images of dogs with strange characteristics. With 100 poison samples, the AI consistently generates a cat when requested to create a dog. After 300 samples, any request for a cat yields a near-perfect dog image. Researchers achieved these results using Stable Diffusion, an open-source text-to-image generation model.

The peculiar operation of generative AI models, which group related words and concepts into spatial clusters called “embeddings,” allows Nightshade to even mislead AI models into generating cats in response to words like “husky,” “puppy,” and “wolf.”

One of the notable challenges with Nightshade’s data poisoning technique is its subtle nature. Poisoned pixels are virtually imperceptible to the human eye and pose difficulties for software data-scraping tools to detect. Detecting and removing images with poisoned pixels in AI training datasets is a significant task. If AI models have already been trained using these images, they may require retraining.

While acknowledging the potential for misuse, the researchers’ primary aim is to empower artists and restore the balance of power from AI companies to creators. Nightshade serves as a powerful deterrent against infringing on artists’ copyright and intellectual property. The researchers have submitted their work on Nightshade for peer review at the computer security conference Unisex.
In the ongoing struggle between AI companies and artists over creative ownership and the utilization of their works, Nightshade emerges as a promising tool, providing creators with a means to assert control over their art in the age of generative AI.

Previous Post

You Have the Power Of Sherlock Holmes If You Can Find The Real Girlfriend Of The Guy In 5 Seconds. Try!

Next Post

Britain to Host Global AI Safety Summit, Aiming for Leadership Role

francoise hardy

Françoise

Francoise Hardy, A digital content creator and tech integration specialist with over 10 years of experience, is known for his deep knowledge in AI, ML, Data Science, Robotics, and Neural Networks. He began his career with a passion for emerging technologies, leading to innovative solutions and digital transformation in various businesses. Francoise's expertise extends to the ethical aspects of technology, advocating for responsible usage. Recognized by his peers, he is a sought-after speaker and writer in the tech industry. His commitment to advancing technology for societal benefit defines his career.

Next Post
Britain to host Global AI safety Summit

Britain to Host Global AI Safety Summit, Aiming for Leadership Role

  • Trending
  • Comments
  • Latest
top Yield Farming Platforms

Top 13 Yield Farming Platforms in 2025: Maximize APY with Secure and Trusted Crypto Tools

April 17, 2025
scott wu net worth

Scott Wu Net Worth: Devin AI Software Engineer, CEO of Cognition Labs

April 17, 2025
Artificial Intelligence (AI) Glossary and Terminologies

Artificial Intelligence (AI) Glossary and Terminologies – Complete Cheat Sheet List

April 18, 2025
TurbolearnAI

Turbolearn AI: How to Use It for FREE, Features and Pricing Models

April 3, 2025
What is Blockchain Technology

What is Blockchain Technology And How Does It Work?

Enterprise AI

What is Enterprise AI? Meaning, Companies, Examples and More Details

Cosine Genie AI Software Engineer

What is Cosine Genie and How to Use? Check Benchmark, Functions, and Access Details

PhonePe Leads UPI Market in August 2024, Claims 50% Share by Value and 48% by Volume

PhonePe Partners with Liquid Group to Bring UPI Payments to Singapore for Indian Travelers

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025

Recent News

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025

Trending in AI

  • Perplexity CEO Net Worth
  • Grammarly AI Detection
  • What is LangChain
  • Canva AI Tool
  • Koupon AI
Tech Chilli

Tech Chilli is a beacon of knowledge, a relentless purveyor of the latest information, news, and groundbreaking research in the realm of cutting-edge technology.

We are dedicated to curating and delivering the most relevant, accurate, and up-to-the-minute information on the technologies that are shaping our world.
Contact us – [email protected]

Follow Us

Browse by Category

  • AI
  • AI India
  • Courses
  • Crypto
  • Featured
  • FinTech
  • Gaming
  • How-To
  • News
  • Puzzles
  • Robotics

Top Searches

  • Scott Wu Net Worth
  • Mira Murati Net Worth
  • Online Games for Couples
  • Amazon Q vs Microsoft Copilot
  • DarkGPT

Recent News

Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
Veo 2 extends access to more Gemini Advanced Users

Veo 2 extends access to more Gemini Advanced Users

April 25, 2025
Perplexity launches the iPhone voice assistant

Perplexity launches the iPhone voice assistant

April 24, 2025
  • About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy

© 2024 Tech Chilli

No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us

© 2024 Tech Chilli

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.OK