Generative Adversial Network Approach for Cartoonifying image using CartoonGAN

Main Article Content

Roshani Raut, Anita Devkar, Pradnya S. Borkar, Radha Deoghare, Sapna Kolambe

Abstract

This research paper aims to discuss the conversion of images into cartoons using NPR algorithms. The goal of NPR is to create images that appear to have been produced by traditional artistic media such as painting, drawing, or cartoons. In this paper, we discuss the NPR algorithm used for converting images into cartoons, including edge detection, color simplification, and shading techniques also discuss the advantages and limitations of the NPR algorithm for cartoon image conversion. The proposed method consists of three main steps: training a GAN model, generating cartoon images using the trained GAN model, and stylizing the generated cartoon images using K-means clustering algorithm. In the first step, a GAN model is trained on a dataset of real images and corresponding cartoon images. The generator network of the GAN model takes a noise vector as input and generates a cartoon image. The GAN model is trained using adversarial loss, which encourages the generator network to generate cartoon images that are similar to the corresponding real images. In the second step, the trained GAN model is used to generate cartoon versions of real images. The generated cartoon images are then segmented into regions using K-means clustering algorithm. The segmented regions are then stylized using the colors from the corresponding clusters. In the third step, the stylized regions are combined to generate the final cartoon image. The proposed method is evaluated on a dataset of real images and corresponding cartoon images. The results show that the proposed method outperforms the state-of-the-art methods regarding visual quality and quantitative metrics. The visual quality of the generated cartoon images is also evaluated using human perception studies, which shows that the proposed method produces cartoon images that are visually appealing and similar to the corresponding real images.

Article Details

Section
Articles
Author Biography

Roshani Raut, Anita Devkar, Pradnya S. Borkar, Radha Deoghare, Sapna Kolambe

1Dr. Roshani Raut

2Ms. Anita Devkar

3Dr.Pradnya S. Borkar

4Mrs. Radha Deoghare

5Sapna Kolambe

1Associate Professor, Department of Information Technology, Pimpri Chinchwad College of Engineering
Pune, India[0000-0002-5477-8841]

2,4,5Assistant Professor, Department of  Information Technology, Pimpri Chinchwad College of Engineering, Pune, India

3Assistant Professor, Department of Computer Science and Engineering, Symbiosis Institute of Technology, Nagpur, Symbiosis International (Deemed University), India

1roshani.raut@pccoepune.org,
2anita.devkar@pccoepune.org,
3pradnyaborkar2@gmail.com,
4radha.deoghare@pccoepune.org,
5sapana.kolambe@pccoepune.org

Copyright © JES 2023 on-line : journal.esrgroups.org

References

Zhang, W., Wang, Y., & Wang, L. (2018). Image cartoonification using convolutional neural networks with augmented training samples. Multimedia Tools and Applications, 77(6), 7225-7241.

Huang, Y., Huang, Q., Lin, X., & Liu, L. (2021). Image Cartoonification Based on a Multi-Scale and Multi-Feature Generative Adversarial Network. IEEE Access, 9, 141994-142009

Characterizing and Improving Stability in Neural Style Transfer, 2017 - Agrim Gupta, Justin Johnson, Alexandre Alahi, Li Fei-Fei.

Several recursive and closed-form formulas for some specific values of partial Bell polynomials. (2022). Advances in the Theory of Nonlinear Analysis and Its Application, 6(4), 528-537. https://atnaea.org/index.php/journal/article/view/175

Image Style Transfer Using Convolutional Neural Networks, 2016 - Leon A. Gatys, Alexander S. Ecker, Matthias Bethge

Yang Chen,Yu-Kun,Yong JIn-Liu, “CArtoonGAN:Generative Advisory Networks for Photo Cartoonification”, Tsinghua University,China, 2020.

Heat transfer analysis of Radiative-Marangoni Convective flow in nanofluid comprising Lorentz forces and porosity effects . (2023). Advances in the Theory of Nonlinear Analysis and Its Application, 7(1), 61-81. https://atnaea.org/index.php/journal/article/view/16

Sathiya, V. ., Josephine, M. S. ., & Jeyabalaraja, V. . (2023). Plant Disease Classification of Basil and Mint Leaves using Convolutional Neural Networks. International Journal of Intelligent Systems and Applications in Engineering, 11(2), 153–163. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2606

Xinrui Wang, Jinze Yu, Learning to Cartoonize using White Box Cartoon Representation, University of Tokyo, 2020.

Gao, Y., Xiong, R., & Zhang, Y. (2019). Image Cartoonification based on Deep Convolutional Neural Networks. Inter-national Journal of Pattern Recognition and Artificial Intelligence, 33(10), 1958001.

Huang, Q., Huang, Y., Lin, X., & Liu, L. (2019). An Image Cartoonification Method Based on Edge Detection and K-Means Clustering. In 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA) (pp. 685-690). IEEE

Amrutha K, Cartoonify Image Using OpenCV and Python, Published On June14,2022,URL: https://www.analyticsvidhya.com/blog/2022/06/cartoonify-image-using-opencv-and-python/, Accessed On: February 18,2023

Cartoonifying an Image Using Machine Learning by Madugula Sai Joshitha, Department of Information Technology, GMR Institute of Technology, pp 1081-1089 November 2022

Gong, C., Jia, J., & Leung, H. (2020). Image cartoonification using generative adversarial networks and K-means cluster-ing. Journal of Visual Communication and Image Representation, 70, 102841.