Multimedia Identification and Analysis Algorithm of Piano Performance Music Based on Deep Learning

Main Article Content

Jing Yang, Ying Zhou, Yuwei Lu

Abstract

A Multimedia Identification and Analysis Algorithm is a computational method designed to recognize and analyze various forms of multimedia content, such as images, videos, and audio. In Piano Music, the study presents a pioneering research endeavor focused on the development of a multimedia identification and analysis algorithm tailored for piano performance music. With the power of deep learning techniques, this algorithm has been designed to address the intricate challenges posed by the convergence of musical data analysis and Piano Musics. The core objectives encompass the extraction, recognition, and interpretation of Piano Music information from piano performances, exploring the intricate patterns, nuances, and individualistic characteristics inherent to musicians. The study focuses on the development of advanced Piano Music authentication and identification systems capable of capturing and analyzing a user's unique behavioral patterns across diverse modalities. These Piano Music modalities offer the potential for highly secure and non-intrusive user identification. Hence, this paper developed an architecture of Marker Controlled Point (MCP) Estimation for the computation of the gesture in Piano Music-based applications. This architecture utilizes markers or reference points to precisely track and analyze user gestures, resulting in accurate and reliable Piano Music data. The research details the architecture's implementation, integrating advanced deep-learning techniques for feature extraction, pattern recognition, and authentication. This system finds versatile applications in various domains, from piano music and cybersecurity to finance, where secure and user-friendly authentication is paramount. Experimental results underscore the system's effectiveness and robustness, demonstrating its potential for enhancing Piano Music authentication. The proposed model represents a significant stride in Piano Music technology, offering secure, non-intrusive user identification through the synergy of behavior Piano Music and emerging modalities.

Article Details

Section
Articles
Author Biography

Jing Yang, Ying Zhou, Yuwei Lu

1Jing Yang

1Ying Zhou

2Yuwei Lu

1Music College,Zhaoqing University, Zhaoqing, Guangdong, 526061, China

2 Guangzhou Cigarette Factory,Guangzhou, 510145, China

*Corresponding author e-mail: yangjing@zqu.edu.cn

Copyright © JES 2023 on-line : journal.esrgroups.org

References

Shopon, M., Tumpa, S. N., Bhatia, Y., Kumar, K. P., & Gavrilova, M. L. (2021). Biometric systems de-identification: Current advancements and future directions. Journal of Cybersecurity and Privacy, 1(3), 470-495.

Shopon, M., Hossain Bari, A. S. M., Bhatia, Y., Narayanaswamy, P. K., Tumpa, S. N., Sieu, B., & Gavrilova, M. (2022). Biometric system de-identification: Concepts, applications, and open problems. Handbook of Artificial Intelligence in Healthcare: Vol 2: Practicalities and Prospects, 393-422.

Abou Elazm, L. A., El-Shafai, W., Ibrahim, S., Egila, M. G., Shawkey, H., Elsaid, M. K., ... & Abd El-Samie, F. E. (2023). Efficient hardware design of a secure cancellable biometric cryptosystem. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 36(1), 929-955.

Kumar, S., Rani, S., Jain, A., Verma, C., Raboaca, M. S., Illés, Z., & Neagu, B. C. (2022). Face spoofing, age, gender and facial expression recognition using advance neural network architecture-based biometric system. Sensors, 22(14), 5160.

Lu, Y., & Zhao, D. (2022). Providing impersonation resistance for biometric-based authentication scheme in mobile cloud computing service. Computer Communications, 182, 22-30.

Palma, D., & Montessoro, P. L. (2022). Biometric-based human recognition systems: an overview. Recent Advances in Biometrics, 1-21.

Annadurai, C., Nelson, I., Devi, K. N., Manikandan, R., Jhanjhi, N. Z., Masud, M., & Sheikh, A. (2022). Biometric Authentication-Based Intrusion Detection Using Artificial Intelligence Internet of Things in Smart City. Energies, 15(19), 7430.

Sarier, N. D. (2021). Comments on biometric-based non-transferable credentials and their application in blockchain-based identity management. Computers & Security, 105, 102243.

Sedik, A., Hammad, M., Abd El-Latif, A. A., El-Banby, G. M., Khalaf, A. A., Abd El-Samie, F. E., & Iliyasu, A. M. (2021). Deep learning modalities for biometric alteration detection in 5G networks-based secure smart cities. IEEE Access, 9, 94780-94788.

Sieu, B., & Gavrilova, M. (2020). Biometric identification from human aesthetic preferences. Sensors, 20(4), 1133.

Azam, S., & Gavrilova, M. (2016, August). Soft biometric: Give me your favorite images and I will tell your gender. In 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI* CC) (pp. 535-541). IEEE.

Iffath, F., & Gavrilova, M. L. (2022). A Novel Three Stage Framework for Person Identification From Audio Aesthetic. IEEE Access, 10, 90229-90243.

Gavrilova, M. L., Anzum, F., Hossain Bari, A. S. M., Bhatia, Y., Iffath, F., Ohi, Q., ... & Wahid, Z. (2022). A multifaceted role of biometrics in online security, privacy, and trustworthy decision making. In Breakthroughs in Digital Biometrics and Forensics (pp. 303-324). Cham: Springer International Publishing.

Iffath, F., & Gavrilova, M. L. (2022). A Novel Three Stage Framework for Person Identification From Audio Aesthetic. IEEE Access, 10, 90229-90243.

Amany Fahmy, & Nouby M. Ghazaly. (2022). The Scope for Improving the Pollution Impact of the Internal Combustion Engine. International Journal on Recent Technologies in Mechanical and Electrical Engineering, 9(1), 30–39. https://doi.org/10.17762/ijrmee.v9i1.363

Gavrilova, M., Luchak, I., Sudhakar, T., & Tumpa, S. N. (2022). Artificial Intelligence in Biometrics: Uncovering Intricacies of Human Body and Mind. In Advances in Selected Artificial Intelligence Areas: World Outstanding Women in Artificial Intelligence (pp. 123-169). Cham: Springer International Publishing.

Kumar, S., Rani, S., Jain, A., Verma, C., Raboaca, M. S., Illés, Z., & Neagu, B. C. (2022). Face spoofing, age, gender and facial expression recognition using advance neural network architecture-based biometric system. Sensors, 22(14), 5160.

Yin, D. B. M., Mukhlas, A. A., Chik, R. Z. W., Othman, A. T., & Omar, S. (2018, December). A proposed approach for biometric-based authentication using of face and facial expression recognition. In 2018 IEEE 3rd International Conference on Communication and Information Systems (ICCIS) (pp. 28-33). IEEE.

Poursaberi, A., Noubari, H. A., Gavrilova, M., & Yanushkevich, S. N. (2012). Gauss–Laguerre wavelet textural feature fusion with geometrical information for facial expression identification. EURASIP Journal on Image and Video Processing, 2012, 1-13.

Yin, D. B. M., Omar, S., Talip, B. A., Muklas, A., Norain, N. A. M., & Othman, A. T. (2017, January). Fusion of face recognition and facial expression detection for authentication: a proposed model. In Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication (pp. 1-8).

Nagpal, R., Nagpal, P., & Malhotra, S. (2012). Biometric techniques and facial expression recognition-A review. Journal of Global Research in Computer Science, 3(11).

Sarangi, D. P. K. . (2022). Malicious Attacks Detection Using Trust Node Centric Weight Management Algorithm in Vehicular Platoon. Research Journal of Computer Systems and Engineering, 3(1), 56–61. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/42

Subclasses of Bi-Univalent Functions Associated with q-Confluent Hypergeometric Distribution Based Upon the Horadam Polynomials. (2021). Advances in the Theory of Nonlinear Analysis and Its Application, 5(1), 82-93. https://atnaea.org/index.php/journal/article/view/186

Fathima, A., & Vaidehi, K. (2020). Review on facial expression recognition system using machine learning techniques. In Advances in Decision Sciences, Image Processing, Security and Computer Vision: International Conference on Emerging Trends in Engineering (ICETE), Vol. 2 (pp. 608-618). Springer International Publishing.

Anil kumar, C., & Sheela, K. A. (2021). Emotion Recognition from Facial Biometric System Using Deep Convolution Neural Network (D-CNN). In Advances in Systems Engineering: Select Proceedings of NSC 2019 (pp. 381-391). Springer Singapore.

Anil Kumar, C., & Anitha Sheela, K. (2021). Emotion Recognition from Speech Biometric System Using Machine Learning Algorithms. In Advances in Communications, Signal Processing, and VLSI: Select Proceedings of IC2SV 2019 (pp. 63-73). Springer Singapore.