Roblox Debuts Generative AI Assistant for Building Virtual Worlds

There is no doubt that Code Assist AI Tool looks promising, however, Roblox states it’s imperfect, and may generate “incorrect” or “misleading” information just like all the other bots out there. At RDC, we shared new tools that will help maintain a safe environment as we roll out new features. This model is the first of its kind deployed at scale, where the AI is directly evaluating voice content and expression, rather than first translating voice to text and then classifying that text.

By Jay Peters, a news editor who writes about technology, video games, and virtual worlds. “Even things like VR and AR will flourish, will really have like a second wave. Because now people can do stuff in those worlds and they can be much faster. I think that’s going to be a big game-changer.” Utilizing Generative AI technology, Roblox now offers an even more engaging and unpredictable gaming experience. The game incorporates advanced algorithms that can generate unique content such as characters, environments, and quests on the fly.

More from this stream Roblox: all the news about the popular social and gaming platform

The company mentioned in its Dev Forum that the tool would generate the object users described within a few seconds, though it will present preview images of what it would create to let users determine if it made the right thing. Each brand that works with Pixis gets it own set of “customized learnings” trained on the brand’s marketing unique data and objectives, Mishra says. Pixis uses these learnings to support its automation and creation tools, also structuring the learnings to deliver them back to the brand in the form of insights and strategies. Roblox said its app will be available this month to all users of the Meta Quest virtual reality headset, after the app was originally released via a test in July. Sony PlayStation console users will also be able to access Roblox on their devices in October. The new coding tools are part of a suite of communications-focused services called Roblox Connect, which Bronstein said will let users make real-life phone calls to their friends and family within the platform as long as everyone has an account.

This architecture enables us to preserve a longer audio sequence so we can detect not only words but also context and intonations. Once all of these elements come together, we have a final system where the input is audio and the output is a classification—violates policy or doesn’t. This system can detect keywords and policy-violating phrases, but also tone, sentiment, and other context that’s important to determine intent. This new system, which detects policy-violating speech directly from audio, is significantly more compute efficient than a traditional ASR system, which will make it much easier to scale as we continue to reimagine how people come together.

Subscribe to Legaltech News

The company additionally envisions a future where users could leverage generative AI tools to make avatars or their clothing using text prompts. And the app is gaining traction in the VR world, where its Meta Quest VR app has topped 1 million downloads. In early 2022, TechDirt reported that a surge in Roblox users during Covid lockdowns spawned new problems for the company. Creators launched games featuring red-light districts, where users could engage in sex acts with other avatars, and some even re-created disturbing mass shootings. In August 2022, leaked documents obtained by Vice News highlighted how Roblox was grappling with moderating things such as “bulges” in avatar clothing, bullying, sexting, and the grooming of minors by child predators on the platform. During a brief Roblox gaming session earlier this week, WIRED observed a gamer repeatedly call another gamer “ugly” in the text chat on the side of the screen and demand that another gamer “get out” of the room.

Yakov Livshits
Founder of the DevEducation project
A prolific businessman and investor, and the founder of several large companies in Israel, the USA and the UAE, Yakov’s corporation comprises over 2,000 employees all over the world. He graduated from the University of Oxford in the UK and Technion in Israel, before moving on to study complex systems science at NECSI in the USA. Yakov has a Masters in Software Development.

Its increasing presence in the AI space and the introduction of advertising could serve as a catalyst for the entertainment stock. But that also leads to the question of whether it can finally build sustainable gains over the next three years.

The state of Roblox

More specifically, to train this new system, we begin with audio and create a transcript. We then run the transcript through our Roblox text filter system to classify the audio. This text filter system is great at detecting policy-violating language on Roblox since we’ve been optimizing this same filter system for years on Roblox-specific slang, abbreviations, and lingo.

But Roblox took the advantage of advances in natural language code generation they have rolled a few weeks ago. According to the company, this generative AI tool will help automate basic coding tasks for a user through a description of what an object should do in their game, per Ars Technica. Years ago, Mishra and Pixis’ other co-founders, Yakov Livshits Hari Valiyath and Vrushali Prasade, met at the Birla Institute of Technology & Science in Pilani, Rajasthan, India. The three were researching generative AI, specifically AI to create art and model assets for games. Prior to this, Kilar was the co-founder and CEO of the subscription video service Vessel, acquired by Verizon in 2016.

To enable everyone on Roblox to have a personalized, expressive avatar, we need to make avatars very easy to generate and customize. At RDC, we announced a new tool we’re releasing in 2024 that will enable easy creation of a custom avatar from an image or from several Yakov Livshits images. With this tool, any creator with access to Studio or our UGC program will be able to upload an image, have an avatar created for them, and then modify it as they like. Longer term, we intend to also make this available directly within experiences on Roblox.

• Once all of these elements come together, we have a final system where the input is audio and the output is a classification—violates policy or doesn’t.
• A majority of marketers report having already incorporated AI into their daily workflows, according to a recent survey by The Conference Board, and most expect further adoption of AI to improve productivity.
• Together, they built a prototype to generate marketing assets, which caught the attention of a large bank chain.
• Having grown 140% year-over-year in 2023, Pixis expects to achieve profitability in Q4.

At the end of these layers of training, we have a model that’s capable of detecting policy violations directly from audio in real time. To make this possible, we are training AI models on Roblox’s avatar schema and a set of Roblox-owned 3D avatar models. One approach leverages research for generating 3D stylized avatars from 2D images. We are also looking at using pre-trained text-to-image diffusion models to augment Yakov Livshits limited 3D training data with 2D generative techniques, and using a generative adversarial network (GAN)-based 3D generation network for training. Finally, we are working on using ControlNet to layer in predefined poses to guide the resulting multi-view images of the avatars. Ultimately, we want each of our 65.5 million daily users to have an avatar that truly represents them and expresses who they are.