Wow, Generative AI, but 3 dimensional. Today experimental, supported by large VC.
3 innovation and digital news in 1 minute. Every Monday. Episode 412.
Robot foundational models by Physical Intelligence (π).
Physical Intelligence (π), is building an operating system for robots, any robot, to perform tasks, any task, at home or in enterprise context. The OS is built on the same technology that powers LLMs, hence the name “robot foundational model”. Early stage and focused on research — backed by top-tier VCs, also OpenAI invested. Opinion: Their first model, π0, was released end of October 2024. Enabling a robot to, autonomously, empty a dryer and fold laundry. Today it’s a demo, early stage. They publish research progress online for everyone to follow.
The researchers believe in big progress in Gen AI models for 2025, VC invest supports the belief. And we are curious for the progress to come.
Real-time generative experiences by Decart.
Decart gained our attention in November when they released Oasis. An AI model that generates a video game world in real-time as you play. They call it “real-time generative experiences”. A demo with the Minecraft game is online for everyone to try. It works in the browser! Opinion: The real asset of Decart is the AI platform behind the “Oasis” demo. They work on improving the efficiency of AI training and faster inference time for LLM in general. Oasis is their proof of concept.
More efficient and faster LLMs at lower cost. A trend that manifested in 2024.
World Labs — “Spatial Intelligence”.
World Labs pushes towards “Large World Models”, generative AI that understands and reasons about 3-dimensional worlds (virtual and real). Also generated 3D outputs. Thus “Spatial Intelligence”, unlike today’s LLMs that are often limited to 2D generation (text, image, video). The company is just a year old, started by Fei-Fei Li, Stanford professor and contributor to foundational AI research. Opinion: Starting out with generating virtual, 3D worlds. For artists, designers, developers, engineers. “Spatial Intelligence” is a new field in Gen AI. Lots of research needed. Concrete applications will follow the progressing research results. No product has been launched by them to date.
Ambitious goal, reputable founder and an early investor list that reads like the “who-is-who” of Silicon Valley. The foundation looks right for World Labs. We will follow them closely.