Runway open-sources its Praxis-1 robot control model under Apache 2.0

Started by MayanHan, Yesterday at 11:18 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: Runway open-sources its Praxis-1 robot control model under Apache 2.0   Views(Read 43 times)
Active members in this topic:
MayanHan(1)

MayanHan

Runway has released a robot control model for anyone to use. The Decoder reports that Praxis-1's weights and code are now on Hugging Face and GitHub under the Apache 2.0 licence, free for commercial use, after only select partners had access since its late September announcement

Runway calls it a World Action Model. It is built on a video model and predicts how a scene will change in order to drive robot movements

On Nvidia's RoboLab-120 benchmark it scored 46.2 percent, against 42.9 percent for Black Forest Labs' FLUX 3 Action, in Runway's own runs. On a real Franka robot arm it succeeded 88 times out of 100 across 10 tasks, against 80 for FLUX 3 Action

It needs an 80GB GPU. A compressed version is expected to fit on an RTX 5090

Using a video model to predict the world and then act on it is an elegant idea, since video models already understand how things move. Open sourcing it under a permissive licence will let researchers and startups build on it quickly. Running on a single high end consumer GPU would make it far more accessible

Will video models become the foundation for robot brains? And how important is open sourcing for robotics progress?

Still figuring it all out