Google merges tokens for movement with language tokens into an integrated model for robotics

Link. “Google’s new robotics model, RT-2 incorporates movement tokens … “into the same training data as the language model … RT-2 can learn to guess how a robot’s arm should move to pick up a ball or throw an empty soda can into the recycling bin.”