Artificial Intelligence (AI) startup, World Labs unveil its first AI system. The currently unname AI system can generate interactive 3D worlds using an image input. These generate worlds turn the 2D visual asset into explorable 3D scenes where users can navigate using a keyboard and mouse.
The AI system is currently in preview and has not made public.
But, the startup, which was found by the computer scientist Fei-Fei Li, said that it is working to release the full version soon.
In a blog post, World Labs showcase the capabilities of its AI model.
World Labs highlight that most generative AI tools today can create 2D content such as images or videos.
As some AI firms do generate 3D models from 2D images or text prompts, the scope is very small.
Google DeepMind has unveil an AI model that generates unique 2D video game levels.
But, based on the interactive assets share by the startup, the unname AI system’s capabilities surpass the generative capabilities seen so far.
World Labs claims users can add any image that depicts a scene as input, and the AI model can generate a 3D interactive version of the scene.
Means users can move forward, backwards, and side-to-side and explore the generate area.
The AI model does not only generate three-dimensional renders of the objects in the image, it also creates unseen details such as new alleyways, ceiling art, new objects and more from scratch.
World Labs claim that apart from the initial image, everything is generate by the AI system.
Also, the generate scenes can also be modified.
You can change camera angles, depth, and zoom as well as add 3D effects to the background as well as the objects in the foreground.
World Labs AI system can also be integrate with other AI tools.
The startup said this will allow creators to first generate the starting image using a familiar text-to-image generator such as Ideogram, Dall-E, or Midjourney and then create a 3D world using the startup’s tool.
The AI firm is currently working with a few creators to test the AI system’s capabilities and its 3D-native generative AI workflow.
As of now, the AI system is not available in the public domain, and the startup highlight that it is still working on it to improve the size and the fidelity of the generated worlds.
But, you can join the company’s waitlist to be inform when the AI system is release.