Comixify uses machine learning to turn video into comics

You can turn any video into the page of a comic book.

Sponsored Links


Tons of comic books have come to life as movies, but researchers at the Warsaw University of Technology have developed a system for turning live-action video into a comic. Comixify picks out the best frames from any video you feed it and turns it into something that looks like it belongs in the pages of a comic.

According to the researchers, the project uses a neural style algorithm based on Generative Adversarial Networks (GANs). The machine learning technique by using two different networks: a generator and a discriminator. The algorithm is fed tons of information, which the generator uses to create new data instances. The discriminator is then tasked with determining if the instance is from the dataset it was trained on or generated by the other network. The process continues until the generator is producing work so similar to the training set that the discriminator can no longer tell the difference.

Because comics only have so many frames, the system has to determine the best, most representative moments from a video to create the comic. Once the algorithm has picked its frames, it then applies the comic style to them. The end result is a pretty reliably solid reimagining of any given video as a page from a comic book.

Turn on browser notifications to receive breaking news alerts from Engadget
You can disable notifications at any time in your settings menu.
Not now

A full paper detailing how Comixify works has been published online. If technical jargon isn't your thing, you can skip right to feeding the algorithm video through a web application.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Popular on Engadget