Snapchat’s New AI Tools Enhance AR Experiences with Custom Lenses and Effects

Snapchat is already expanding the options for users and content creators while providing early access to its in-development on-device AI model that will disrupt the augmented reality (AR) space. This new model will allow creators to turn words in the text prompts into special lenses and allow people to come up with creative ideas on how it looks and share them with their friends.

A glimpse of what this new AI model can do can be referred to in the GIF below, wherein an individual and the background change immediately based on the “50s sci-fi film.”

The expansion will also feature extra tools that will have AI capabilities, which Snapchat has indicated it will launch to enhance the ease of creating custom AR effects. There is one new face effect available in Lens Studio that permits the user to engrave a caption or image to get a new lens that can alter the looks of a user entirely.

New GenAI Tools for AR Creators

A new toolkit also arrives Immersive ML, a fully equipped application that facilitates realistic transformations on the face, the body, and the smallest surroundings of the user in real time.

Lens Studio AI tools in succession will encompass the ability for a lens creator to generate new 3D objects by text or image descriptions, masks and textures for the faces, and 3D heads of characters that become animated based on the facial expression of the user.

In recent times, we have noticed that Snapchat has gone a step further with the use of the algorithm on its platform; for instance, asking subscribers to make use of AI to create snaps for them while availing an AI chatbot in the form of an open chat, ChatGPT. The creators of Snapchat are constantly developing AI models; with the next on-device AI model in the making, the possibilities of AR experiences are enlarged; making the desired level of creativity for creators and the audience easier to achieve.

Also Read: Apple Unveils ‘Apple Intelligence’ AI, Limited Developer Access This Summer

With Snapchat continuing to focus on improving the role of AI within its platform, this means that consumers can expect even further development on features shortly based on social media’s primary development direction. Apart from improving the user experience of the application, adopting AI technology in the platform has also helped Snapchat stand out as the leading company in the provision of augmented reality and social applications.

Therefore, with Snapchat’s planned on-device AI model in the future and existing and upcoming new AI tools, the application and creation of augmented reality will continue to evolve and will make way for unique and more interesting AR experiences.

Meta AI Introduces Pixel Transformers for Enhanced Computer Vision