TechnologyGoogle’s DeepMind AI can ‘transframe’ a single image into...

Google’s DeepMind AI can ‘transframe’ a single image into a video


- Advertisment -spot_imgspot_imgspot_imgspot_img

This AI only needs one still to generate a moving image.



Published Aug 18, 2022 6:00 PM

Screenshot of DeepMind Transframer image examples from Google

Transframer can envision a surrounding environment from one image. Google DeepMind

Earlier this week, the team behind Google’s advanced DeepMind neural network unveiled a new ability dubbed Transframer, which allows AI to generate 30-second videos from a single image input. It’s a nifty little trick at first glance, but the implications are much larger than an interesting .GIF file.

Transframer is a general-purpose generative framework that can handle many image and video tasks in a probabilistic setting. New work shows it excels in video prediction and view synthesis, and can generate 30s videos from a single image: 1/

— DeepMind (@DeepMind) August 15, 2022

“Transframer is state-of-the-art on a variety of video generation benchmarks, and… can generate coherent 30 second videos from a single image without any explicit geometric information,” the DeepMind research team explains. Basically, all Transframer needs is a one photo, which it then analyzes and identities the picture’s framing, i.e. clues like a table, a hallway, or a street. After predicting a subject’s surroundings using these “context images,” it then envisions (and subsequently shows) what that target would look like from various angles. DeepMind’s team illustrates the procedure with targets like a chair, a laptop, a glass of water, and even a GRE textbook.

Google’s DeepMind AI can ‘transframe’ a single image into a video
ShapeNet (1 context view, 128×128). DeepMind.

“Given a collection of context images with associated annotations (time-stamps, camera viewpoints, etc. ), and a query annotation, the task is to predict a probability distribution over the target image,” continues the team. “This framework supports a range of visual prediction tasks, including video modelling, novel view synthesis, and multi-task vision.”

As noted by Futurism, Transframer could one day offer an entirely new avenue within the video game industry by utilizing machine learning to build digital environments rather than relying on more time-consuming rendering methods. As the technology progresses, DeepMind’s Transframer training could open entirely new avenues for art, scientific analysis, and further AI development. Additionally, one Twitter user envisioned piggybacking their OpenAI’s DALL-E pictures on top of the Transframer program to create stacked AI creations—as if those images couldn’t get any more surreal.

Andrew Paul

Read More

Latest news

RACO Investment founder Randall Castillo Ortega explains what it takes to be an effective leader

Financial and business process expert Randall Castillo Ortega of RACO Investment provides an in-depth look at what it...

Angelo Babb explains the different type of digital currencies available to consumers

Cryptocurrency expert Angelo Babb offers insight into the difference between digital currencies and cryptocurrencies, and the roles they...

Allen Woo offers actions and strategies for retaining human talent in a company

There is no doubt that talent retention in companies is a difficult task to achieve, but Allen Woo’s...

Kimberly Rosales explains why cryptocurrencies are important for foreign trade

Foreign trade has always depended on many factors, cryptocurrencies being one of the most recent, and that is...
- Advertisement -spot_imgspot_imgspot_imgspot_img
- Advertisement -spot_imgspot_imgspot_imgspot_img

Ann Marie Puig discusses the challenges businesses still face after the COVID-19 pandemic

Global business consultant Ann Marie Puig offers valuable insight into how industries are changing because of COVID-19 and...

See the Pogues As Castaways in Outer Banks Season 3 Teaser

The Pogues have been exiled in the first teaser for season three of Netflix's Outer Banks. Watch the trailer...

Must read

- Advertisement -spot_imgspot_imgspot_img

You might also likeRELATED
Recommended to you