Home About us

Domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Qubits 2024/08/19 13:32

What level is the CEO of the hottest AI robot figure overseas to pay attention to for the first time?

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

The domestic humanoid robot shows off its muscles, and its latest skill is to play the piano and make kung fu tea...... And the spoon?!

Holding the bamboo in your hand, you can strike each string with precision and lightness, and play beautiful music.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Skillfully brew a pot of kung fu tea, more than a dozen processes, several cups and pots are easy to handle.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Finish a fragrant waffle and end it with an heirloom spoon.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

"Leisure" can also take you to practice Wing Chun, isn't this the robot version of Master Yip?

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Note that the above operations are all completed independently by the robot, and the original double speed is displayed.

Not only is the hand super stable, but also the movements are smooth and smooth in one go, like eating Dove.

Even for the tedious long sequence task of making kung fu tea, it also plans it clearly in its mind, and handles more than a dozen different steps, different materials such as ceramics, metal, wood, and tea, as well as bowls, cups, pots, and cups of different shapes.

This requires robots to learn, plan, and execute like humans, with strong generalization capabilities and general intelligence.

The above is the Chinese humanoid robot Astribot S1 officially released today.

Developed by start-up Astribot, it will be unveiled to the public at the World Robotics Conference in Beijing from August 21 to 25.

In April this year, S1 in the first technology display, with ironing and folding clothes, sorting and tidying, turning the pot, vacuuming to competitive cups and other dozens of robots are difficult to show off their skills, which are really useful to people, and the first appearance has caused a lot of discussion at home and abroad.



United States netizens exclaimed: China's AGI-level robots are shocked! Yes! Karma!

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

In less than 4 months, the Astribot S1 was officially released as a complete machine, what did it do for you this time?

Do housework and make tools show martial arts decathlon

A large part of Astribot S1's skills are the most important part of doing housework. The slogan is:

You don't have to worry about traveling far away (although you go to the waves), I protect the warmth of the family. You are at home (let me come), and I will help you enjoy life.

Make waffles first, warm.

S1 can hold the spoon firmly and scoop out the batter and pour it into the waffle maker.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

After recognizing that the batter is spread all over the bottom of the pan, it grabs the handle and closes the lid.

In this process, the robot's waist joint is very important. Grabbing the open handle requires a leaning motion. If the robot's waist does not fit the upper arm, it is difficult to complete this large forward stretch.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Then "twist on" the knob to heat up the batter.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

"Grab" the fork to take the cake, and do not forget to show the operation of "turning" the wrist to turn the cake.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

I continue challenging the brewing kung fu tea of the long long long process and am warm.

It not only tests the fine operation of the robot, but also looks at the intelligent planning when the complexity of the environment, tasks, and items is intertwined.

Tea brewing generally involves multiple links such as tea washing, brewing, pouring tea, and dividing tea, and each link requires a variety of different tools.

It needs to figure out which tools to use at each stage and grasp a whole range of completely different objects.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

It requires real-time adjustment of force control. For example, when scooping tea leaves out of a ceramic cup, the ceramic is smooth and brittle, and cannot be grasped too vigorously; But the next action is to pick up the metal kettle and pour water, and the robot will adjust the force control in real time to ensure that the kettle can be picked up and poured water.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

In addition to this, the Astribot S1 also uses a vacuum cleaner. How does it know that the force of the waist and thigh arch can reduce backache...... I'm afraid I often go to the gym.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Feed the cats and cats, especially warm.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Or even tease the cat remotely.

The owner only needs to wear the XR headset, and he can play with his cat owner at the workstation and suck the cat with pay!

Astribot S1 will remotely obtain the trajectory of human hand movements in real time through the device, and then calculate how to coordinate its arms according to the trajectory, so as to ensure that it can effectively interact with cats at home, and at the same time, it will not mess up the room or be accidentally injured.

This requires the robot's motion system to be able to respond quickly and handle complex spatial relationships.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

At the same time, the Astribot S1 is a silky replica of more expert skills.

For example, playing the dulcimer.

Because the strings and bamboo are elastic, the requirements for precise force control are extremely high, and the robot must accurately feedback the force sense immediately every time it is struck, and adjust the percussion angle in real time. S1: I'm too hard......

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

And the last time I lost a paper plane, this time I made a shot.

This action requires the robot to work together with the whole body, starting with bending over with the ball and raising the elbows, then adjusting the wrists as the waist gradually stands upright, and finally throwing the basketball with the waist and hands at the same time.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

There is also a trailer in the trailer, dancing seaweed dancing also ends up at the limit, and the degree of freedom explodes.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Compared with the first technology demonstration 3 months ago, the Astribot S1 has been hanging all the way.

Not only has the range of movement and operation become larger, but the environment and tasks have also become more complex and more refined.

How does Astribot S1 achieve these difficult, long-sequence, generalizable tasks?

High-value upper body + landing lower body

First of all, in terms of form, the Astribot S1 adopts the route of a humanoid upper body + wheeled chassis.

The operation of the upper limbs is gradually becoming the focus of embodied intelligence, and the mammals that can work with their hands in nature are basically mammals with a very high level of intelligence, while most of the human operations are completed by the upper limbs and hands, so the intelligent decision-making + operation of the upper body has become the core technical barrier to solve the real needs and can be applied practically. When the S1 was first launched in April, it focused on the "strongest operation" among robots of the same specification.

On behalf of the lower body of the mobility ability, Stardust chose the "landable" wheeled type, which has high stability, low energy consumption, simple control, and more importantly, humans live and work in a flat environment most of the time, such as homes, offices, factories and shopping malls, etc., and the wheeled type has been able to cover a large part of the application scenarios.

The head, hands, and torso are all modular in design, which can be flexibly assembled or disassembled according to different needs.

The S1's physical indicators are extremely human-like, with a single-arm degree of freedom of 7, which is the same as that of a human. The hand has 2 mechanical fingers that can do most tasks, and the dexterous hand is also being developed.

The movement and single-arm load capacity are more than that of ordinary human males, and the positioning accuracy is 0.03mm.


Efficient collection of multi-dimensional data breaks through the bottleneck of embodied intelligence

If the intelligence of robots looks at AI, then AI depends on the three elements of data, algorithms and computing power.

GPT's breakthrough is based on tens of billions of training data, which is easily accessible on the Internet. Whereas, when training a robot, there is almost zero data available directly. Therefore, whether high-quality and cheap enough data can be obtained has become a bottleneck restricting the development of robots and an important means to open up the company's competition.

Stardust has a unique advantage in the acquisition of embodied intelligent data.

On the one hand, S1 can quickly learn from massive real-world video data and human motion capture data. In addition, the S1 can efficiently collect multi-dimensional and high-quality data that is closest to the real world, such as vision, hearing, touch, and force perception from a first-person perspective.

By combining these high-quality data, Stardust can carry out more efficient large-scale training, while reducing the cost of collecting high-quality data of the robot, the magnitude of data and the difficulty of training new tasks, and greatly improving the generalization.

When interacting with the real world, S1 can continuously generate new "learning materials", so as to continue to learn and evolve, and move towards general artificial intelligence. This is the key to how S1 learns, thinks, and acts like a human.

In terms of AI algorithms, large models are loaded to enable S1 to have perception, cognition, and real-time decision-making capabilities in complex environments, as well as intelligent understanding and multi-modal interactive execution capabilities, so as to realize the generalization of general operations at the object, task, and environment levels.

This means that S1 has the "strongest brain", which can adapt to new environments and new things more quickly, "draw inferences from one another" and "know everything".

Rigid-flexible coupling transmission is the strongest and safer to operate

The omnipotence of a robot is greatly dependent on its body, that is, its body or hardware.

The S1's "strongest operation" comes from its unique rigid-flex coupling transmission mechanism design. By incorporating sensors into the drive, the S1 monitors the transmission of force in real time. For example, when peeling cucumbers, instead of relying on trajectory estimation, like a human, accurately perceive the force when the paring knife is pressed on the cucumber, and then accurately control the output of the force, this special transmission structure significantly improves the operation accuracy.

It is worth mentioning that through the rigid-flexible coupling hardware design and innovative force planning algorithm, the S1 has extremely high security. Through rigid-flexible coupling hardware design and innovative force planning algorithm, it can accurately control the force in the interaction, and do not hurt people, objects or itself in motion. Safe enough, it is possible to land.

Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

Thanks to this set of carefully polished and complete technical solutions, the release of Astribot S1 can always give people a sense of "amazing technology".

At present, the field of embodied intelligence is in a period of "a hundred flowers blooming". Not only are there many rookies, but the forms and technical routes of each robot also have their own merits.

How did the Astribot S1 technology roadmap come about?

It was created by the No. 1 employee of Tencent Robotics Lab

To answer this question, we need to start with the team behind Astribot S1.

Astribot, founded in December 2022; The name is derived from the old Latin proverb "Ad astra per aspera", which means "through the arduous journey to reach the stars", and represents the company's long-term plan and strong commitment to the popularization of AI robotics.

Founder and CEO Lai Jie, with 16 years of experience in robot research and development, is a "veteran" in the field of AI and robotics. He joined Baidu in 2014 and later served as the team leader of "Xiaodu Robot".

In 2018, Dr. Zhang Zhengyou, a world-renowned expert in the field of computer vision and robotics, is also a distinguished scientist with the highest professional rank at Tencent, and was preparing to establish the Tencent RoboticsX Robotics Lab.

Dai Yuan, another founder of Stardust Intelligence, received a bachelor's degree from UIUC and a doctorate from UCLA, focusing on robot perception. She has published more than 30 papers in top journals such as Nature Comm and Science Adv, and holds more than 70 robotics patents. Like Laijie, she joined the newly founded RoboticsX in 2018.

Thanks to the experience in Tencent's RoboticsX Robotics Lab, Stardust Intelligence attaches great importance to the "integration of software and hardware" capabilities of Design for AI, and has also built a team structure similar to RoboticsX, half of which focuses on the robot ontology, and the other half emphasizes the use of AI algorithms for perception and motion control, so as to explore the strong coupling of AI and robots.

Most of the team members are from Tencent, Google, Huawei, DJI and other companies, as well as top universities and artificial intelligence research institutes at home and abroad.

Empower billions of people with AI bot assistants

From day one, Stardust Intelligence's vision is to empower billions of people with AI robot assistants.

Such a robot assistant must be able to learn, think and work like a human, interact with people smoothly and intelligently, use human tools and equipment, and help people complete boring, difficult or dangerous tasks, so as to continuously expand the boundaries of application scenarios and lead the technological innovation of "AI + robot".

The company soon completed tens of millions of dollars in Pre-A round of financing, led by Matrix Partners Ventures, followed by industrial capital such as Daotong Investment and Qinghui Investment, and over-invested by the old shareholder Yunqi Capital.

From the technology demonstration in April and the release of the whole machine in August, Stardust also announced that it will be commercialized in 2024. And through the self-development of key components, S1 has obvious cost advantages and price competitiveness.

In short, in all aspects, the pace of Stardust Intelligence is very fast.

And the fastest, I'm afraid, is the robot itself. In April, the founder and CEO Lai Jie said:

Everyone is welcome to come and ask for S1!

In this way, its ability can grow from 55% and 85% to 99.99%, which is infinitely close to the human level.

The ability to play Wing Chun shown above may come from April netizens, and now it has been realized.


Qubits, domestic AI robots are so advanced... Playing the piano, making tea, playing Wing Chun, and petting cats??

So what do you want S1 to do for you?

Feel free to comment on it!

This article is from Xinzhi self-media and does not represent the views and positions of Business Xinzhi.If there is any suspicion of infringement, please contact the administrator of the Business News Platform.Contact: system@shangyexinzhi.com