mirror of
https://github.com/maciej3031/comixify.git
synced 2026-03-11 08:54:35 +00:00
Update README.md
This commit is contained in:
parent
313cf0d96f
commit
ca91400730
1 changed files with 14 additions and 9 deletions
23
README.md
23
README.md
|
|
@ -1,10 +1,15 @@
|
|||
# comixify
|
||||
Repository with code for the "Comixify: Transform video into a comics" paper, that can be faound here:
|
||||
https://arxiv.org/abs/1812.03473
|
||||
|
||||
#TODO:
|
||||
- [ ] Prepare readme
|
||||
- [x] Download videos directly from YouTube
|
||||
- [x] Fix model loading to memory
|
||||
- [x] Replace ffmpeg with some keyframes extractor
|
||||
- [x] Prepare own ComixGAN
|
||||
- [ ] Prepare some more intelligent method for comic layout
|
||||
- [ ] Prepare some method for voice extraction
|
||||
In this paper, we propose a solution to transform a video into a comics. We approach this task using a
|
||||
neural style algorithm based on Generative Adversarial Networks (GANs). Several recent works in
|
||||
the field of Neural Style Transfer showed that producing an image in the style of another image is
|
||||
feasible. In this paper, we build up on these works and extend the existing set of style transfer use
|
||||
cases with a working application of video comixification. To that end, we train an end-to-end solution
|
||||
that transforms input video into a comics in two stages. In the first stage, we propose a state-of-the-art
|
||||
keyframes extraction algorithm that selects a subset of frames from the video to provide the most
|
||||
comprehensive video context and we filter those frames using image aesthetic estimation engine. In
|
||||
the second stage, the style of selected keyframes is transferred into a comics. To provide the most
|
||||
aesthetically compelling results, we selected the most state-of-the art style transfer solution and based
|
||||
on that implement our own ComixGAN framework. The final contribution of our work is a Web-based
|
||||
working application of video comixification available at http://comixify.ii.pw.edu.pl
|
||||
|
|
|
|||
Loading…
Reference in a new issue