Latest in Gear

Image credit:

Comixify uses machine learning to turn video into comics

You can turn any video into the page of a comic book.
AJ Dellinger, @ajdell
December 12, 2018
Share
Tweet
Share

Sponsored Links

Comixify

Tons of comic books have come to life as movies, but researchers at the Warsaw University of Technology have developed a system for turning live-action video into a comic. Comixify picks out the best frames from any video you feed it and turns it into something that looks like it belongs in the pages of a comic.

According to the researchers, the project uses a neural style algorithm based on Generative Adversarial Networks (GANs). The machine learning technique by using two different networks: a generator and a discriminator. The algorithm is fed tons of information, which the generator uses to create new data instances. The discriminator is then tasked with determining if the instance is from the dataset it was trained on or generated by the other network. The process continues until the generator is producing work so similar to the training set that the discriminator can no longer tell the difference.

Because comics only have so many frames, the system has to determine the best, most representative moments from a video to create the comic. Once the algorithm has picked its frames, it then applies the comic style to them. The end result is a pretty reliably solid reimagining of any given video as a page from a comic book.

A full paper detailing how Comixify works has been published online. If technical jargon isn't your thing, you can skip right to feeding the algorithm video through a web application.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
Tweet
Share

Popular on Engadget

The 2020 Engadget Holiday Gift Guide

The 2020 Engadget Holiday Gift Guide

View
China's lunar sampling robot beams back its first full-color moon shots

China's lunar sampling robot beams back its first full-color moon shots

View
DJI’s cinematic FPV drone leaks in photos

DJI’s cinematic FPV drone leaks in photos

View
Amazon UK begins replacing 'stolen' launch day PS5s

Amazon UK begins replacing 'stolen' launch day PS5s

View
My return to ‘No Man’s Sky’ was a reminder of death and the void

My return to ‘No Man’s Sky’ was a reminder of death and the void

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr