The DeanBeat: Building the metaverse for free

Join Gaming Leaders, alongside GamesBeat and Facebook Gaming, for their second annual GamesBeat and Facebook Games Summit | GamesBeat: Into the Metaverse 2 on January 25-27, 2022. Learn more about the event.

Jensen Huang last night received the highest honor of the chip industry, the Robert N. Award. Noyes, at an event with his friends. And while the evening was all about semiconductors and artificial intelligence, one thing the founder and CEO of Nvidia said caught my attention.

Speaking on stage with former New York Times reporter John Markoff, Huang said Nvidia has found a goal in using artificial intelligence and simulation technology made possible by its graphics chips and neural network algorithms of deep learning. His company gathers all the experts it needs to simulate climate science so that the world’s largest supercomputers can model climate change and predict how the Earth will change over decades. Huang will use this to warn us all of the fate of the earth. On top of that, he will build us the meta-bar for free.

In order to do that, Nvidia will have to build something on the foundation of its Omniverse, the “Meteors for Engineers” that has become a platform for simulating “digital twins”. For example, BMW is building a digital twin of a car factory, and once it does the right simulation, it will build the exact same thing in the physical world.

Top: Following the announcements of both Facebook and Microsoft, Nvidia has become the third major technology company in recent weeks to announce its push for metaverse.

On Thursday night, it echoed something he announced at the Nvidia GTC conference last week. He said that Nvidia plans to build the most powerful supercomputer in the world with artificial intelligence dedicated to climate change forecasting. Named Earth-2, or E-2, the system will create a digital twin of the Earth in the universe.


The second annual summit of GamesBeat and Facebook Gaming and GamesBeat: Into the Metaverse 2

Learn more

“All the technologies we have invented up to this moment are necessary to make Earth-2 possible. I can not imagine a larger or more important use,” Huang said last week.

He said the simulation would be so accurate that it would require precision at the meter level, and if necessary Nvidia would spend the money to offset the computing power used to run the simulation. The challenge will be to take decades of climate data from satellite recordings and then put them into the supercomputer for simulation purposes, Huang said.

Jensen Huang is the CEO

Above: Jensen Huang, CEO of Nvidia.

Image credit: Nvidia

And last night, he added, “We’re going to build this digital twin of the Earth. It’s going to be huge. It’s going to be the largest supercomputer on artificial intelligence on Earth. It’s going to bring some of the most brilliant computer scientists, physical scientists and the most brilliant climate scientists. On Earth go and use this computer to predict how the Earth will change over decades.

It struck me that if Nvidia were to build this exact world physically in the universe, it would be the metaphorical equivalent in the real world. So I went up to Huang later and took a selfie with him. Then I asked him, “If you build this digital twin of the earth, do you get the Matevers for free.”

And he said, “If we build the Earth’s digital twin, we’ll get the Towers for free.”

This is going to be a huge task, and Nvidia can justify finding the sources of funding and expertise needed to tackle climate change as a problem by building this Omniverse, which could replicate many of the Earth’s specifications for other game developers and meta-versions. Developers will have to create their own virtual worlds, like a replica of New York that we can use in the game.

To be sure, some of the details will be different. As Richard Kris, head of development at Omniverse told me in an interview, game developers want a lot of the world to run fast so people can move at 60 frames per second, and he noted that some of the details of the world will be too thin for this purpose.

But that’s the point. Nvidia is going to build this version of the world anyway. Game developers can use this for their own purposes and use Omniverse as the free base for anything they want to build for entertainment purposes.

Dual-use technologies

Top: Jensen Huang from Nvidia and Dean Takahashi from GamesBeat.

Photo credit: Dean Takahashi

I’ve always wondered how ambitious companies are going to build something like metaverse, and now I see that some things are more important to the character, and if we get those things, we get a very special bonus in the form of a copy. Of the Earth, which we can use as a springboard for our imagination to build our versions of the meta-bars.

It reminds me of “dual-use” technologies once developed for the military, like original 3D simulators that trained soldiers how to propel tanks or fly airplanes. These simulators have become the basis for modern 3D video games, from virtual reality simulations to fighter jet games. Here, we will have one of the most important scientific projects of all time, with contributions from so many experts.

Maybe world governments can provide Nvidia with some of the funding it needs, or Nvidia, with a market capitalization of $ 789 billion, can afford to build it itself. And once it is built, it can become the basis for the modern metaverse.

My point is this. We often do not get a lot of things for free. But if we are investing in solving a problem that can decipher our climate and help everyone understand something that could kill our planet, then we should be grateful that we should have something like the Mtavers – that will help us enjoy our virtual worlds without killing the planet. As a by-product.

Omniverse avatars in organizations and games

Jensen Huang, CEO

Above: Jensen Huang, CEO of Nvidia Introduces Omniverse Avatar.

Image credit: Nvidia

On another level, Nvidia is also creating artificial intelligence characters to model the behavior of pedestrians and self-driving cars. She invests the investment to recreate human-like behavior, and last week she also unveiled her Omniverse Avatar, which are 3D characters that can use artificial intelligence to serve things as non-game characters in games.

Huang said these Omniverse avatars will be full of cool technologies, including speech recognition, speech synthesis, natural speech synthesis from text, multilingual translation, face animation, eye tracking and more that will go into creating quality game characters.

“When you play these games, you just go talk to the characters inside,” he said. “They will understand. They will really understand. You will say, ‘Go up there and turn right.’ You can talk to your team, talk to your partners. It’s going to be so interesting. They’ll talk back. “A tank that comes around the corner, and because they see it, not just because it encodes the game that way. They will see it. It will be much easier for the characters to use the concept than for the programmer to write everything into the software.”

Huang thinks one of the more important reasons to create Omniverse’s avatars is to provide better customer service.

Earth -2

Above: Earth-2 simulation arrives.

Image credit: Nvidia

“There is a severe shortage of drive-throughs, fast food. Now we have allowed you to have a very good conversation with Avatar,” he said. “You can say it almost any way you want. You can ask him for recommendations. There are many ways to describe a burger now, but he will still recognize what you mean. Everything from customer service, smart retail, you name it. There are 25 million restaurants and shops. “And everyone is out of work. This is going to be one of the leading areas.”

Omniverse’s avatars are another example of dual-use technologies. They will be built for customer service, which is a compelling business model. (And I hope it does not just eliminate human jobs.) But it will also provide the human-like avatars we need in the millions as the realistic characters within a game world or a meta-versatile world.

These world-wide avatars can be cut off from the universe if we want them to be, Huang said. But if they learn a new behavior that is more realistic, it must be fed back into the universe to improve the models of the characters. Again, I came up with the idea of ​​how the Omniverse can become a meta-versa – at least of the kind that game developers have created.

Jensen Huang tells John Markoff that he prepared a 90-minute speech for his award ceremony.

Above: Jensen Huang tells John Markoff that he prepared a 90-minute speech for his award ceremony.

Photo credit: Dean Takahashi

“There are so many different applications for metaverse,” Huang said. “For consumers, for video games and consumers we’ve already talked about, we’re probably the engine. We’ve the basic technology. We’re the engine of it. In the case of enterprise use, especially industrial use, we’ll be the whole engine, the whole digital twin simulation engine.”

He added, “In the case of Edge – this retail application we were talking about is really edge computing from an organizational point of view. It’s just so cute you no longer think of it as an end computing application. But it’s almost the ultimate end computing app. Instead of a fleet of tractors or “AMR’s fleet, autonomous moving robots, it’s a bunch of little animated characters. That’s what drives these pixels. These are really robotics applications. They’re just really cute.”

And he said, “Eterprise Edge remains one of the great opportunities for the Meta-Wars, for the Omniverse. At the other end, of course, is all the consumer stuff. With consumers, the way we work with the industry is very similar to the way we work with the video game industry today. “The basic engine, the infrastructure. It could be in the cloud. It could be GFN. It could be in their cloud. We’ll provide the infrastructure at the engine level.”


GamesBeat’s belief in gaming industry coverage is “the place where passion meets business.” What it means? We want to tell you how important the news is to you – not only as a game studio decision maker, but also as a gaming enthusiast. Whether you’re reading our articles, listening to our podcasts, or watching our videos, GamesBeat will help you learn about the industry and enjoy engaging with it.

How will you do it? Membership includes access to:

  • Newsletters, such as DeanBeat
  • The wonderful, informative and fun speakers at our events
  • Networking opportunities
  • Special interviews for friends only, chats and “open office” events with the GamesBeat team
  • Chat with community members, the GamesBeat team and other guests on our Discord
  • And maybe even a fun prize or two
  • Familiarity with parties with similar views

Become a friend


Related Articles