MIT scientists have discovered an effective method for teaching robots from large AI language models

Researchers at the Massachusetts Institute of Technology (MIT) have developed their own method for teaching robots new skills. Instead of the standard set of focused data that is usually used to train robots, they used large data sets, thereby simulating the process of training large language models (LLMs).

Image source: Mit

According to researchers from MIT, imitation learning, when a robot learns from the actions of a person performing a particular task, may not be effective if the environment changes insignificantly. For example, the robot may have difficulties after training if it is placed in an environment with different lighting or objects.

In their work, the researchers used different LLMs, such as GPT-4, to improve the quality of brute-force learning. “In the field of language models, all data is just sentences. In robotics, given all the heterogeneity of data, if you want to do pre-training in a similar way, then you need a different architecture,” said Lirui Wang, one of the authors of the study.

The researchers have developed a new architecture called Heterogeneous Pretrained Transformers (HPT), which combines information from different sensors and different environments. The data collected in this way is combined into trainable models using a “transformer”. The end user only needs to specify the robot’s design, its configuration, and the skill it needs to learn.

«Our dream is to create a universal robot brain that you can download and use in your robot without any training. We are still in the early stages, but we are going to continue to work hard and hope that scaling will lead to a breakthrough in robotics, as it did with large language models,” said one of the authors of the study, David Held.

admin

Share
Published by
admin

Recent Posts

Threads gets ‘long overdue improvements’ to search and trends

Meta✴ Platforms, the owner of the social network Threads, announced “long overdue improvements” for its…

57 minutes ago

Ubisoft spoke about the capabilities and innovations of stealth mechanics in Assassin’s Creed Shadows – new gameplay

Image source: Ubisoft Let us remind you that the events of Assassin’s Creed Shadows will…

2 hours ago

Assembly of the second NASA SLS rocket has started – in a year it will send people on a flight around the Moon

NASA announced that assembly of the second lunar rocket, SLS (Space Launch System), has begun…

2 hours ago

The creators of Black Myth: Wukong will surprise players before the end of the year – teaser from the head of Game Science

Co-founder and CEO of the Chinese studio Game Science, Feng Ji, hinted that some surprises…

4 hours ago

Nvidia stock is no longer the best performer – MicroStrategy soars 500% in a year thanks to Bitcoin

Last Wednesday, trading volume in MicroStrategy shares exceeded that of Nvidia and Tesla. The company,…

4 hours ago

Tired of waiting: sales of S.T.A.L.K.E.R. 2: Heart of Chornobyl exceeded one million copies within two days of release

The post-apocalyptic open-world shooter S.T.A.L.K.E.R. 2: Heart of Chornobyl from the developers from the GSC…

5 hours ago