Latest in Gear

Image credit: Comixify

Comixify uses machine learning to turn video into comics

You can turn any video into the page of a comic book.
344 Shares
Share
Tweet
Share
Save

Sponsored Links

Comixify

Tons of comic books have come to life as movies, but researchers at the Warsaw University of Technology have developed a system for turning live-action video into a comic. Comixify picks out the best frames from any video you feed it and turns it into something that looks like it belongs in the pages of a comic.

According to the researchers, the project uses a neural style algorithm based on Generative Adversarial Networks (GANs). The machine learning technique by using two different networks: a generator and a discriminator. The algorithm is fed tons of information, which the generator uses to create new data instances. The discriminator is then tasked with determining if the instance is from the dataset it was trained on or generated by the other network. The process continues until the generator is producing work so similar to the training set that the discriminator can no longer tell the difference.

Because comics only have so many frames, the system has to determine the best, most representative moments from a video to create the comic. Once the algorithm has picked its frames, it then applies the comic style to them. The end result is a pretty reliably solid reimagining of any given video as a page from a comic book.

A full paper detailing how Comixify works has been published online. If technical jargon isn't your thing, you can skip right to feeding the algorithm video through a web application.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
344 Shares
Share
Tweet
Share
Save

Popular on Engadget

The best consoles, games and accessories for students

The best consoles, games and accessories for students

View
Gene editing tool could treat many diseases created by mutations

Gene editing tool could treat many diseases created by mutations

View
Volvo's Polestar engineered XC60 is fast, but still reserved

Volvo's Polestar engineered XC60 is fast, but still reserved

View
Netflix thriller 'Clickbait' will explore the dark side of social networks

Netflix thriller 'Clickbait' will explore the dark side of social networks

View
'Dota 2' champions won more money than top Wimbledon players

'Dota 2' champions won more money than top Wimbledon players

View

From around the web

Page 1Page 1ear iconeye iconFill 23text filevr