Home About us

The unmanned car team marches into Hollywood across dimensions! Launched film-level visual AI special effects, "Pixar in the new era"

Qubits| 2024/07/09 13:52
A water from the concave non-temple
qubit |

Hollywood-level visual AI is born! A demo has made netizens crazy~

Let's watch the video directly:

The above is from Odyssey, which can create Hollywood-level story shots of mountains, plains, vegetation, oceans, rivers, etc.

The biggest highlight is that it achieves full control over the core layer of visual storytelling, giving the user full control over every generated element and aspect of the scene.

This breaks through the biggest obstacle of existing video AI – controllability.

After reading the effect, some netizens raised their arms and shouted:

A new era of Pixar!

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

Others are the first to become beta testers.

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

Why is Odyssey worth paying attention to? Let's take a look at it together.

Hollywood-grade visual AI

Odyssey was inspired by the groundbreaking computer graphics research of the '80s and '90s and the story of Pixar's founding.

There are two cores involved here: one is technology, and the other is story.

What Odyssey is going to do is use artificial intelligence to make movies, TV shows and video games.

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

The biggest obstacle to achieving this goal is AI controllability.

Odyssey proposed a new solution:

More powerful models.

They are training 4 generative models to achieve full control over the core layer of visual storytelling.

Each of the 4 individual models will be generated, e.g. high-quality geometry:

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

To generate a photorealistic material:

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

Generate realistic lighting and shadows (control time, change of seasons):

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

Generate Controlled Motion:

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

In summary, a single model can be used to precisely configure scene details, and when combined, a complete video or scene can be generated.

In addition, Odyssey allows users to iterate continuously, and its generation workflow will be combined with professional-grade version control.

Its founders mentioned:

Odyssey has been designed to be easily integrated into existing workflows or systems that are being used in Hollywood and beyond

Odyssey is building workflows around these models tailored for power users, integrating with existing production workflows used in Hollywood, gaming, and more.

All the content it creates can be edited and exported in a standardized 3D file format, e.g. using the USD format.

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

However, one thing to say, although Odyssey looks pretty good, sharp-eyed netizens still found some minor bugs.

For example, the hand detail at 00:30:

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

Finally, the official also released a rendering video of how it works:

About the team

What's interesting is that Odyssey's team has a deep relationship with self-driving cars.

According to the founders, most of its members have spent years building AV (autonomous vehicle) technology.

For example, the two core founders.

CEO Oliver Cameron, angel investor in more than 60 DeepTech startups, has been working in the field of autonomous vehicles since the early days of his career.

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

CTO Jeff Hawke, responsible for Odyssey Directional Vision AI, with research interests in machine learning, computer vision, robotics, etc.

During his PhD at the Oxford Institute of Robotics, he developed an expert hybrid vision system for autonomous driving and mobile robots.

In addition, while working at Wayve, a self-driving car manufacturer, he created the industry's first self-driving car that uses deep learning and computer vision to drive on public roads.

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

To paraphrase founder Jeff Hawke:

Self-driving cars are taught how to navigate the world, and Odyssey is taught how to generate worlds.

As for the relevance to AV, he boiled it down to 3 points:

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

Given the team's extensive experience with self-driving cars, Odyssey naturally turned to 3D and generated multi-layered 3D worlds.

And with multiple generative models, Odyssey is able to fine-tune the details.

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

In addition, to create a Hollywood-grade visual AI, Odyssey recruited a team of AI researchers and Hollywood artists.

Researchers come from Cruise, Wayve, Waymo, Tesla, Meta, and more, and the artist is behind Dune, Godzilla, The Avengers, and more.

Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"
Qubit, unmanned vehicle team cross-dimensional into Hollywood! Launched film-level visual AI special effects, "Pixar in the new era"

So what do you think of the Odyssey?

Reference links:
[1]https://x.com/olivercameron/status/1810335663197413406
[2]https://x.com/jeffrey_hawke/status/1810435686136197303

This article is from Xinzhi self-media and does not represent the views and positions of Business Xinzhi.If there is any suspicion of infringement, please contact the administrator of the Business News Platform.Contact: system@shangyexinzhi.com