News Report Technology
December 15, 2022

Google releases a “GPT-like” robot model, the RT-1

Google has released a new robot model, the RT-1, which is similar to the GPT model used in its OpenAI artificial intelligence program. The new model is designed with Google’s other robotics programs, including its driverless car program, in mind. The RT-1 model presented here is a step toward generative AI models in the field of robotics. In the real world, the RT-1 can execute over 700 instructions with a 97% success rate.

Google releases a "GPT-like" robot model, the RT-1

The recent advances in machine learning (ML) research, such as computer vision and natural language processing, have been enabled by a shared common approach that uses large, diverse datasets and expressive models. Although there have been various attempts to apply this approach to robotics, robots so far have not used highly-capable models as much as other subfields.

Google releases a “GPT-like” robot model, the RT-1
The model encodes a written command and a set of images as tokens using a pre-trained FiLM EfficientNet model before compressing them using TokenLearner. This is the architecture of RT-1. The Transformer then receives these and produces action tokens.

Developers gathered a sizable, varied dataset of robot trajectories in order to develop a system that could generalize to new tasks and demonstrate robustness to various distractions and backgrounds. To gather 130k episodes over 17 months, they deployed 13 EDR robot manipulators, each of which has a 7-degree-of-freedom arm, a two-finger gripper, and a mobile base. The researchers used human examples obtained by remote teleoperation, and they marked each event with a written explanation of the command that the robot had just carried out. Picking and arranging objects, opening and closing drawers, getting objects into and out of drawers, positioning elongated objects upright, knocking over objects, pulling napkins, and opening jars are among the high-level skills included in the dataset.

The following video displays a few sample PaLM-SayCan-RT1 long-horizon task performances in several actual kitchens.

In all four areas, RT-1 performs significantly better than baselines, displaying exceptional levels of generalization and resilience.

Google releases a “GPT-like” robot model, the RT-1

The RT-1 Robotics Transformer is an action-generation model for real-world robotics tasks that is simple and scalable. It tokenizes all inputs and outputs and compresses them using a pre-trained EfficientNet model with early language fusion and a token learner. RT-1 demonstrates strong performance across hundreds of tasks, as well as extensive generalization and robustness in real-world settings.

Learn more:

Disclaimer

In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.

About The Author

Damir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet. 

More articles
Damir Yalalov
Damir Yalalov

Damir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet. 

Hot Stories
Join Our Newsletter.
Latest News

From Ripple to The Big Green DAO: How Cryptocurrency Projects Contribute to Charity

Let's explore initiatives harnessing the potential of digital currencies for charitable causes.

Know More

AlphaFold 3, Med-Gemini, and others: The Way AI Transforms Healthcare in 2024

AI manifests in various ways in healthcare, from uncovering new genetic correlations to empowering robotic surgical systems ...

Know More
Read More
Read more
Lumoz Unveils esMOZ Airdrop Details And Opens Inquiry, Rewarding Community With 1B Tokens
News Report Technology
Lumoz Unveils esMOZ Airdrop Details And Opens Inquiry, Rewarding Community With 1B Tokens
November 5, 2024
Gate.io Sets New Record For Total Trading Volume In Q3 2024 As Its User Base Surpasses 17M
News Report Technology
Gate.io Sets New Record For Total Trading Volume In Q3 2024 As Its User Base Surpasses 17M
November 5, 2024
Kamino Finance Launches New Jito Market In Kamino Lend To Accelerate JitoSOL Growth
News Report Technology
Kamino Finance Launches New Jito Market In Kamino Lend To Accelerate JitoSOL Growth
November 5, 2024
Arcium Acquires Core Technology And Team From Inpher To Enhance Network Performance And Capabilities
Business News Report Technology
Arcium Acquires Core Technology And Team From Inpher To Enhance Network Performance And Capabilities
November 4, 2024