Amazon Trusted AI Challenge: University Students to Tackle AI Security in Global Contest

Amazon has recently declared a global university competition called the Amazon Trusted AI Challenge, the sole purpose of which is to fuel secure advances in Generative AI systems. The contest should be devoted to safe AI and its concentration will be on the coding security of large language models (LLM).

Rohit Prasad, senior vice president and head scientist, Amazon AGI stated that “We are focusing on advancing the capabilities of coding LLMs, exploring new techniques to automatically identify possible vulnerabilities and effectively secure these models. The goal of the Amazon Trusted AI Challenge is to see how students’ innovations can help forge a future where generative AI is consistently developed in a way that maintains trust while highlighting effective methods for safeguarding LLMs against misuse to enhance their security.”

In the tournament-styled battle, students from the universities will be required to participate as model developer teams or as red teams. Model developer teams will implement security solutions into code generation models, and on the other side, red teams will create methods that automatically analyze these models. Each round will enable the teams to perfect their models and approaches based on real-life, multi-turn conversations and ascertain the advantages and drawbacks of such models.

Amazon Launches ML Summer School India 2024; Check Eligibility, Registration, and Fees

The competition will be held in the academic year starting in November 2024, and during this time, Amazon will select up to 10 teams. Every member that is in the selected 10 teams will get $250,000 for sponsorship and monthly AWS credits for every team and there is more than $700,000 up for grabs for the winning teams.

To address this concern, a new challenge known as the Amazon Trusted AI Challenge was initiated to increase the safety, dependability, and credibility of the LLMs used in the AI-supported software development tools. Reflecting the emergence of generative AI coding assistants, these technologies showcase the unprecedented innovative potential and address prophylactic and promising opportunities for their proper and safe application. This challenge aimed at encouraging developers, scientists and researchers to come up with solutions that would improve the secularity of these AI-powered coding assistant tools for the users and systems.

Featuring four tournaments and a live finals event, red teams will attack model developer teams’ AI models to expose the problems and strengthen the code. The performance metrics of red teams will be based on the effectiveness of models to violate their policies and guidelines in the red-teaming conversational paradigm. Developing model teams shall produce code generation models to improve security, threat detection and mitigate undesired conduct. Their performance on the value chain will also be evaluated on the extent to which they can construct and strengthen good defence delivery mechanisms using aspects such as balancing and reclamation.

Difference between Amazon Q and Microsoft Copilot