MIT scientists have discovered an effective method for teaching robots from large AI language models

Researchers at the Massachusetts Institute of Technology (MIT) have developed their own method for teaching robots new skills. Instead of the standard set of focused data that is usually used to train robots, they used large data sets, thereby simulating the process of training large language models (LLMs).

Image source: Mit

According to researchers from MIT, imitation learning, when a robot learns from the actions of a person performing a particular task, may not be effective if the environment changes insignificantly. For example, the robot may have difficulties after training if it is placed in an environment with different lighting or objects.

In their work, the researchers used different LLMs, such as GPT-4, to improve the quality of brute-force learning. “In the field of language models, all data is just sentences. In robotics, given all the heterogeneity of data, if you want to do pre-training in a similar way, then you need a different architecture,” said Lirui Wang, one of the authors of the study.

The researchers have developed a new architecture called Heterogeneous Pretrained Transformers (HPT), which combines information from different sensors and different environments. The data collected in this way is combined into trainable models using a “transformer”. The end user only needs to specify the robot’s design, its configuration, and the skill it needs to learn.

«Our dream is to create a universal robot brain that you can download and use in your robot without any training. We are still in the early stages, but we are going to continue to work hard and hope that scaling will lead to a breakthrough in robotics, as it did with large language models,” said one of the authors of the study, David Held.

admin

Share
Published by
admin

Recent Posts

Amazon launched a Mass Effect series, and BioWare added armor to Dragon Age: The Veilguard in honor of N7 Day

BioWare warned that due to the release of Dragon Age: The Veilguard there would be…

36 mins ago

Arcane became the most expensive animated series in history by a wide margin.

On the eve of the start of the second season of the animated series Arcane…

1 hour ago

Sony has priced the PlayStation 5 Pro 30th Anniversary in the style of the first PlayStation at $1000

Sony today began sales of the PlayStation 5 Pro game console, and also announced the…

2 hours ago

The first portable set-top box with Ryzen AI 300 goes on sale for $1099–1699 – you will be given a medal for its purchase

One-Netbook has announced the start of accepting pre-orders for the OneXFly F1 Pro portable gaming…

2 hours ago

Nvidia will limit monthly gaming time in the GeForce Now cloud service – you will have to pay for additional hours

Nvidia has announced that starting next year it will change its subscription policy for its…

2 hours ago

Old school steampunk role-playing game New Arc Line will be released soon, but not completely – release date and early access announcement

Fulqrum Publishing (formerly 1C Publishing) and developer Dreamate have announced the release date for the…

3 hours ago