Roblox Unveils AI-Driven 3D Tools for Real-Time World Building

At RDC 2024, Roblox introduces AI-powered 3D tools for real-time world building. Create assets from text and video directly in gameplay.

Brain Titan
4 min readSep 9, 2024

At the 2024 Roblox Developer Conference (RDC) , CEO David Baszucki announced a major innovation for Roblox — an AI-driven “3D base model” . This tool is designed to create 3D assets from text, video, and 3D cues, enabling real-time world building that is directly integrated with gameplay.

Roblox has been gradually incorporating generative AI technology into its creator development tools, such as:

  • Assistant: A tool that automates common tasks for developers.
  • Texture Generator: Automatically generate textures for 3D models, reducing manual operation time.
  • Avatar Auto Setup Tool: Simplifies the steps of creating a personalized appearance for your game characters.

However, Baszucki emphasized that these tools are just preliminary attempts, and Roblox plans to take AI technology to a new level, so that AI can not only help developers generate single elements, but also dynamically generate complete 3D world scenes.

Roblox is developing a 3D base model that is capable of generating complex 3D environments and objects based on a variety of inputs such as text, video, or 3D cues. The demo showed the following features:

  • Real-time conversion from text to 3D: With simple text prompts (such as describing a desert), AI can automatically generate 3D scenes. The developer then uses a simple command to convert the desert into a forest scene. This prompt-based generation capability makes it easier to create complex 3D environments.
  • Multimodal input: In addition to text, users can also use videos or 3D prompts to guide AI to generate the required scenes or objects. This means that in the future, developers can work with AI more intuitively to complete projects.

The real innovation of this AI tool is that it can create 3D content in real time and deeply integrate with gameplay . This feature will give players and developers greater creative freedom, especially in open world and sandbox games. The future Roblox experience will likely be a dynamic world generated entirely by AI and influenced by players in real time. Baszucki described a scenario: for example, in a virtual D&D game, the game world can be generated instantly as described by the dungeon master, and every action of the player can affect the changes in the environment in real time.

Although the features look very exciting, Baszucki also mentioned that the technology is still in the early stages of research and development, and there are currently about 40 employees dedicated to the development of this project. Nevertheless, just three months of development have demonstrated preliminary results. Although the capabilities currently demonstrated are pre-recorded demonstrations on stage, the effectiveness of actual applications still needs further verification.

He also mentioned some important backend technical improvements, such as:

  • Optimization of the platform technology stack: Improve application startup speed, frame rate, and reduce the chance of crashes.
  • High performance, multiplayer support: Roblox is working on supporting open world, sports, or fighting games with up to 100 players and ensuring that these games can run smoothly on devices with only 2GB of RAM.

Baszucki emphasized that Roblox’s goal is to create a game creation platform that everyone can participate in, regardless of the developer’s technical level. Generative AI will become a key element, helping developers quickly create complex 3D environments and lowering the development threshold. He also pointed out that future Roblox games may dynamically generate new game content with the real-time participation of multiple players.

In addition, Roblox plans to continue improving its AI technology to reach new heights in resource efficiency, enabling complex game content to run on low-configuration devices.

At the Roblox Developer Conference (RDC) 2024 , CEO David Baszucki also revealed the company’s grand vision: to achieve 1 billion daily active users and have 10% of global game content revenue flow to the Roblox platform. This goal is quite ambitious, especially considering that Roblox currently has 79.5 million daily active users, which is far from the 1 billion goal.

More about AI: https://kcgod.com

--

--