GTLNLP: A Mathematical Exploration of Cross-Domain Knowledge Transfer for Text Generation for Generative Transfer Learning in Natural Language Processing

Main Article Content

Swati Bula Patil, Sopan Talekar, Mohini Vyawahare, Amol A. Bhosle, Manoj Vasantrao Bramhe, Archana Bajirao Kanwade

Abstract

In the field of Cross-Domain Knowledge Transfer generative transfer learning in Natural Language Processing (NLP) used for creating text using generative math. The paper aims to improve the usefulness of text creation models in a variety of areas by using cutting edge deep learning and neural network methods. We come up with a new system that makes it easier for information to move from one domain to another, even when the language and situation are different in each domain. Using domain adaptation techniques to match feature distributions and reduce domain gaps is what our method is based on mathematically. It is a complex version of transfer learning principles. We test our model's abilities on a wide range of tasks by doing a lot of careful experiments. We focus on how well it can share information and write text that makes sense and is relevant to the situation across different areas. This study not only adds to our theoretical understanding of cross-domain knowledge transfer, but it also gives us useful tips on how to make NLP models more flexible and useful in the real world. The results of our study could help improve the state of the art in generative transfer learning and make text generation systems that work better and more reliably in a variety of language settings.

Article Details

Section
Articles
Author Biography

Swati Bula Patil, Sopan Talekar, Mohini Vyawahare, Amol A. Bhosle, Manoj Vasantrao Bramhe, Archana Bajirao Kanwade

[1]Swati Bula Patil

2Dr. Sopan Talekar

3Dr.Mrs.Mohini Vyawahare

4Dr. Amol A. Bhosle,

5Dr. Manoj Vasantrao Bramhe

6Dr Archana Bajirao Kanwade

 

[1]Assistant Professor in Vishawakarm Institute Of Information Technology, Pune, Maharashtra, India Email: swati.patil@viit.ac.in

2Associate Professor, MVPSS Karmaveer Adv. Baburao Thakare College of Engineering, Nashik, Maharashtra, India. Email: sopan.talekar@gmail.com

3Assistant Professor & Head Robotics and AI Department, Priyadarshini College of engineering, Nagpur, Maharashtra, India. Email: mohini.vyawahare@pcenagpur.edu.in

4Associate Professor, Department of Computer Science and Engineering School of Computing, MIT Art Design and Technology University Pune, India. Email:  amolabhosle@gmail.com

5Professor, Department of Information Technology, St. Vincent Pallotti College of Engineering and Technology, Nagpur, Maharashtra, India. Email: mbramhe@stvincentngp.edu.in

6Associate Professor, Marathwada MitraMandal College of Engineering, Pune, Maharashtra, India.

archana_kanwade@yahoo.com

 

References

H. Tan, X. Liu, M. Liu, B. Yin and X. Li, "KT-GAN: Knowledge-Transfer Generative Adversarial Network for Text-to-Image Synthesis," in IEEE Transactions on Image Processing, vol. 30, pp. 1275-1290, 2021

R. S. Perdana and Y. Ishida, "Instance-based Deep Transfer Learning on Cross-domain Image Captioning," 2019 International Electronics Symposium (IES), Surabaya, Indonesia, 2019, pp. 24-30

M. Yang et al., "Multitask Learning for Cross-Domain Image Captioning," in IEEE Transon Multimedia, vol. 21, no. 4, pp. 1047-1061, April 2019.

M. Ramprasath, K. Dhanasekaran, T. Karthick, R. Velumani and P. Sudhakaran, "An Extensive Study on Pretrained Models for Natural Language Processing Based on Transformers," 2022 International Conference on Electronics and Renewable Systems (ICEARS), Tuticorin, India, 2022, pp. 382-389

M. Toshevska and S. Gievska, "A Review of Text Style Transfer Using Deep Learning," in IEEE Transactions on Artificial Intelligence, vol. 3, no. 5, pp. 669-684, Oct. 2022, doi: 10.1109/TAI.2021.3115992.

H. Xiong and R. Sun, "Transferable Natural Language Interface to Structured Queries Aided by Adversarial Generation," 2019 IEEE 13th International Conference on Semantic Computing (ICSC), Newport Beach, CA, USA, 2019, pp. 255-262, doi: 10.1109/ICOSC.2019.8665499.

Ajani, S. N. ., Khobragade, P. ., Dhone, M. ., Ganguly, B. ., Shelke, N. ., & Parati, N. (2023). Advancements in Computing: Emerging Trends in Computational Science with Next-Generation Computing. International Journal of Intelligent Systems and Applications in Engineering, 12(7s), 546–559

Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova, "BERT: pre-training of deep bidirectional transformers for language understanding", NAACL-HLT, 2019.

S. Khan, M. Naseer, M. Hayat, S. W. Zamir, F. S. Khan and M. Shah, "Transformers in vision: A survey", 2021.

S. Panda, A. Agrawal, J. Ha and B. Bloch, "Shuffled-token detection for refining pre-trained roberta", Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pp. 88-93, 2021.

K. Agnihotri, P. Chilbule, S. Prashant, P. Jain and P. Khobragade, "Generating Image Description Using Machine Learning Algorithms," 2023 11th International Conference on Emerging Trends in Engineering & Technology - Signal and Information Processing (ICETET - SIP), Nagpur, India, 2023, pp. 1-6.