PMSIEMDL: Design of a Pattern analysis Model for identification of Student Inclination towards different Educational-fields via Multimodal Deep Learning Fusions

Main Article Content

Ashwini Raipure, Sarika Khandelwal


Identification of student inclination towards different educational fields requires integration of deep pattern learning models with temporal data analysis techniques. These techniques are highly context sensitive, and cannot be scaled for analysis of students that have an interest in multiple domains. Moreover, existing deep learning models are highly complex, and showcase moderate performance when used on real-time datasets. To overcome these limitations, this text proposes design of a Pattern analysis Model for identification of Student Inclination towards different Educational-fields via Multimodal Deep Learning fusions. The proposed model initially collects data samples from a large number of students, and segregates them into different classes. These include social data, personal habits data, education data, family related data, performance data and future inspiration data classes. These datasets were combined with a customized psychological questionnaire which was curated by experts in the field of student counselling & psychology. Based on student responses, their entity specific classes were generated, that were separately trained via different Convolutional Neural Network (CNN) Models, which assists in identification of student-performance at individual-class levels. These performances are compared with existing inclination datasets via a fusion of Long-Short-Term Memory (LSTM) & Gated Recurrent Neural Network (GRNN), which assists in identification of correlation between subject-level inclinations & their entity classes. This provides with a probabilistic map of different subjects towards which the student might be inclined, and assists them to select their study streams. The generated map was validated for multiple students, and recommendations were made based on higher probability values, which assisted in identification of student inclination levels. The model was evaluated under large datasets and its performance was compared with various state-of-the-art methods under different scenarios. Based on this comparison, it was observed that proposed model was capable of achieving 8.5% better recommendation accuracy, 4.9% higher prediction precision, 6.5% better recommendation recall & 2.9% better Area Under the Curve (AUC) levels, which makes it highly useful for a wide variety of student inclination use cases

Article Details

Author Biography

Ashwini Raipure, Sarika Khandelwal

[1]Ashwini Raipure

2Sarika Khandelwal


[1] PhD Research scholar, G H Raisoni Unversity Amaravati,

2Associate Professor in CSE Department, G H Raisoni College of Engineering, Nagpur.



Altuwairqi, K., Jarraya, S.K., Allinjawi, A. et al. Student behavior analysis to measure engagement levels in online learning environments. SIViP 15, 1387–1395 (2021).

Bao, W. COVID-19 and online teaching in higher education: A case study of Peking University. Hum Behav & Emerg Tech. 2020; 2: 113– 115.

Hoi, VN, Le Hang, H. The structure of student engagement in online learning: A bi-factor exploratory structural equation modelling approach. J Comput Assist Learn. 2021; 37: 1141– 1153.

Xiaoying Shen, Chao Yuan, "A College Student Behavior Analysis and Management Method Based on Machine Learning Technology", Wireless Communications and Mobile Computing, vol. 2021, Article ID 3126347, 10 pages, 2021.

Hellings, J., Haelermans, C. The effect of providing learning analytics on student behaviour and performance in programming: a randomised controlled experiment. High Educ (2020).

Lin, CL., Jin, Y.Q., Zhao, Q. et al. Factors Influence Students’ Switching Behavior to Online Learning under COVID-19 Pandemic: A Push–Pull–Mooring Model Perspective. Asia-Pacific Edu Res 30, 229–245 (2021).

Mailizar, M., Burg, D. & Maulina, S. Examining university students’ behavioural intention to use e-learning during the COVID-19 pandemic: An extended TAM model. Educ Inf Technol (2021).

Morris, J., Slater, E., Fitzgerald, M.T. et al. Using Local Rural Knowledge to Enhance STEM Learning for Gifted and Talented Students in Australia. Res Sci Educ 51, 61–79 (2021).

Nandi, R., Nedumaran, S. Understanding the Aspirations of Farming Communities in Developing Countries: A Systematic Review of the Literature. Eur J Dev Res 33, 809–832 (2021).

Khan, Sharifullah & Hwang, Gwo-Jen & Abbas, Muhammad & Rehman, Arshia. (2018). Mitigating the urban–rural educational gap in developing countries through mobile technology‐supported learning. British Journal of Educational Technology. 50. 10.1111/bjet.12692.

Nelson, I.A. (2016), Rural Students’ Social Capital in the College Search and Application Process. Rural Sociology, 81: 249-281.

L. Wenyuan, W. Siyang and W. Lin, "A Multiperson Behavior Feature Generation Model Based on Noise Reduction Using WiFi," in IEEE Transactions on Industrial Electronics, vol. 67, no. 6, pp. 5179-5186, June 2020, doi: 10.1109/TIE.2019.2927179.

R. Zheng, F. Jiang and R. Shen, "Intelligent Student Behavior Analysis System for Real Classrooms," ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, pp. 9244-9248, doi: 10.1109/ICASSP40776.2020.9053457.

Y. Ikawati, M. U. H. Al Rasyid and I. Winarno, "Student Behavior Analysis to Detect Learning Styles in Moodle Learning Management System," 2020 International Electronics Symposium (IES), 2020, pp. 501-506, doi: 10.1109/IES50839.2020.9231567.

A. Fekry, G. Dafoulas and M. Ismail, "Automatic detection for students behaviors in a group presentation," 2019 14th International Conference on Computer Engineering and Systems (ICCES), 2019, pp. 11-15, doi: 10.1109/ICCES48960.2019.9068128.

L. Wang, Z. Zhen, T. Wo, B. Jiang, H. Sun and X. Long, "A Scalable Operating System Experiment Platform Supporting Learning Behavior Analysis," in IEEE Transactions on Education, vol. 63, no. 3, pp. 232-239, Aug. 2020, doi: 10.1109/TE.2020.2975556.

S. Delgado, F. Morán, J. C. S. José and D. Burgos, "Analysis of Students’ Behavior Through User Clustering in Online Learning Settings, Based on Self Organizing Maps Neural Networks," in IEEE Access, vol. 9, pp. 132592-132608, 2021, doi: 10.1109/ACCESS.2021.3115024.

H. Wan, Q. Yu, J. Ding and K. Liu, "Students' behavior analysis under the Sakai LMS," 2017 IEEE 6th International Conference on Teaching, Assessment, and Learning for Engineering (TALE), 2017, pp. 250-255, doi: 10.1109/TALE.2017.8252342.

J. Deng, "College Students’ Online Behavior Analysis During Epidemic Prevention and Control," 2021 13th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA), 2021, pp. 796-799, doi: 10.1109/ICMTMA52658.2021.00183.

P. Sun, Z. Wu, Y. Zhang and Y. Yang, "Analysis and Modeling of Learning Behaviors on Intelligent Tutoring Website," 2014 Tenth International Conference on Computational Intelligence and Security, 2014, pp. 729-731, doi: 10.1109/CIS.2014.170.

M. E. Rodríguez, A. -E. Guerrero-Roldán, D. Baneres and I. Noguera, "Students’ Perceptions of and Behaviors Toward Cheating in Online Education," in IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, vol. 16, no. 2, pp. 134-142, May 2021, doi: 10.1109/RITA.2021.3089925.

S. Lai, B. Sun, F. Wu and R. Xiao, "Automatic Personality Identification Using Students’ Online Learning Behavior," in IEEE Transactions on Learning Technologies, vol. 13, no. 1, pp. 26-37, 1 Jan.-March 2020, doi: 10.1109/TLT.2019.2924223.

F. B. Shaikh, M. Rehman, A. Amin, A. Shamim and M. A. Hashmani, "Cyberbullying Behaviour: A Study of Undergraduate University Students," in IEEE Access, vol. 9, pp. 92715-92734, 2021, doi: 10.1109/ACCESS.2021.3086679.

D. Aviano, B. L. Putro, E. P. Nugroho and H. Siregar, "Behavioral tracking analysis on learning management system with apriori association rules algorithm," 2017 3rd International Conference on Science in Information Technology (ICSITech), 2017, pp. 372-377, doi: 10.1109/ICSITech.2017.8257141.

M. Awais Hassan, U. Habiba, H. Khalid, M. Shoaib and S. Arshad, "An Adaptive Feedback System to Improve Student Performance Based on Collaborative Behavior," in IEEE Access, vol. 7, pp. 107171-107178, 2019, doi: 10.1109/ACCESS.2019.2931565.

A. M. Villa, C. P. Molina and M. Castro, "Students’ Behavior When Connecting to the LMS: A Case Study at UNED," in IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, vol. 14, no. 3, pp. 87-94, Aug. 2019, doi: 10.1109/RITA.2019.2942253.

D. Liu, Y. Zhang, J. Zhang, Q. Li, C. Zhang and Y. Yin, "Multiple Features Fusion Attention Mechanism Enhanced Deep Knowledge Tracing for Student Performance Prediction," in IEEE Access, vol. 8, pp. 194894-194903, 2020, doi: 10.1109/ACCESS.2020.3033200.

Z. Xu, H. Yuan and Q. Liu, "Student Performance Prediction Based on Blended Learning," in IEEE Transactions on Education, vol. 64, no. 1, pp. 66-73, Feb. 2021, doi: 10.1109/TE.2020.3008751.

P. Jiang and X. Wang, "Preference Cognitive Diagnosis for Student Performance Prediction," in IEEE Access, vol. 8, pp. 219775-219787, 2020, doi: 10.1109/ACCESS.2020.3042775.

H. Tang et al., "Predicting Green Consumption Behaviors of Students Using Efficient Firefly Grey Wolf-Assisted K-Nearest Neighbor Classifiers," in IEEE Access, vol. 8, pp. 35546-35562, 2020, doi: 10.1109/ACCESS.2020.2973763.

R. A. Rasheed, A. Kamsin and N. A. Abdullah, "An Approach for Scaffolding Students Peer-Learning Self-Regulation Strategy in the Online Component of Blended Learning," in IEEE Access, vol. 9, pp. 30721-30738, 2021, doi: 10.1109/ACCESS.2021.3059916.

X. Li, Y. Zhang, H. Cheng, F. Zhou and B. Yin, "An Unsupervised Ensemble Clustering Approach for the Analysis of Student Behavioral Patterns," in IEEE Access, vol. 9, pp. 7076-7091, 2021, doi: 10.1109/ACCESS.2021.3049157.

S. Vhaduri, S. V. Dibbo and Y. Kim, "Deriving College Students’ Phone Call Patterns to Improve Student Life," in IEEE Access, vol. 9, pp. 96453-96465, 2021, doi: 10.1109/ACCESS.2021.3093493.

P. Song, Y. Gao, Y. Xue, J. Jia, W. Luo and W. Li, "Human Behavior Modeling for Evacuation From Classroom Using Cellular Automata," in IEEE Access, vol. 7, pp. 98694-98701, 2019, doi: 10.1109/ACCESS.2019.2930251.

W. M. Al-Rahmi, N. Yahaya, M. M. Alamri, N. A. Aljarboa, Y. B. Kamin and F. A. Moafa, "A Model of Factors Affecting Cyber Bullying Behaviors Among University Students," in IEEE Access, vol. 7, pp. 2978-2985, 2019, doi: 10.1109/ACCESS.2018.2881292.

F. D. Pereira et al., "Explaining Individual and Collective Programming Students’ Behavior by Interpreting a Black-Box Predictive Model," in IEEE Access, vol. 9, pp. 117097-117119, 2021, doi: 10.1109/ACCESS.2021.3105956.

S. A. Priyambada, M. Er, B. N. Yahya and T. Usagawa, "Profile-Based Cluster Evolution Analysis: Identification of Migration Patterns for Understanding Student Learning Behavior," in IEEE Access, vol. 9, pp. 101718-101728, 2021, doi: 10.1109/ACCESS.2021.3095958.

S. Nam, G. Frishkoff and K. Collins-Thompson, "Predicting Students Disengaged Behaviors in an Online Meaning-Generation Task," in IEEE Transactions on Learning Technologies, vol. 11, no. 3, pp. 362-375, 1 July-Sept. 2018, doi: 10.1109/TLT.2017.2720738.

W. -Y. Hwang, I. Q. Utami, S. W. D. Purba and H. S. L. Chen, "Effect of Ubiquitous Fraction App on Mathematics Learning Achievements and Learning Behaviors of Taiwanese Students in Authentic Contexts," in IEEE Transactions on Learning Technologies, vol. 13, no. 3, pp. 530-539, 1 July-Sept. 2020, doi: 10.1109/TLT.2019.2930045.

R. Lavi, Y. J. Dori, N. Wengrowicz and D. Dori, "Model-Based Systems Thinking: Assessing Engineering Student Teams," in IEEE Transactions on Education, vol. 63, no. 1, pp. 39-47, Feb. 2020, doi: 10.1109/TE.2019.2948807.