Optimizing Resource Allocation in Cloud for Large-Scale Deep Learning Models in Natural Language Processing
Main Article Content
Abstract
The need for big deep learning models in Natural Language Processing (NLP) keeps rising, it's important to find the best way to divide up cloud resources so that they can be used efficiently and at high speeds. This solves the problems that come with setting up and handling large NLP models by suggesting a complete strategy for making the best use of cloud-based platforms' resources. Combining model parallelism, data parallelism, and dynamic scaling methods, the suggested approach spreads the computing load across multiple cloud instances in better way. The framework constantly changes how resources are allocated to handle changes in workload by taking into account the specifics of NLP tasks, such as the need for different model designs and data processing needs. To improve scale and cut down on inference delay, a new auto-scaling method is introduced that lets computing resources be changed automatically based on demand in real time. The framework uses machine learning-based prediction models to figure out what resources will be needed in the future. This lets you make proactive decisions about scaling and keeps you from underusing or overprovisioning resources. It also solves the problem of communication overhead in distributed environments by improving data exchange protocols and using advanced inter-process communication techniques. The results of the experiments show that the proposed framework works well at improving both cost-effectiveness and prediction performance for large-scale NLP models by making the best use of resources. The framework is flexible enough to work with a wide range of natural language processing (NLP) tasks. It makes a useful addition to the efficient use of deep learning models in cloud settings.
Article Details
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
References
H. Qiao, L. Yu and Y. Duan, "Analysis of Evolutionary Model of DIKW Based on Cloud Resource Allocation Management," 2021 IEEE 23rd IntConf on High Performance Computing & Communications; 7th IntConf on Data Science & Systems; 19th IntConf on Smart City; 7th IntConf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys), Haikou, Hainan, China, 2021, pp. 2172-2179, doi: 10.1109/HPCC-DSS-SmartCity-DependSys53884.2021.00282.
X. Dai, X. Chen, L. Jiao, Y. Wang, S. Du and G. Min, "Priority-Aware Task Offloading and Resource Allocation in Satellite and HAP Assisted Edge-Cloud Collaborative Networks," 2023 15th International Conference on Communication Software and Networks (ICCSN), Shenyang, China, 2023, pp. 166-171, doi: 10.1109/ICCSN57992.2023.10297374.
H. Park et al., "HPC2 lusterScape: Increasing Transparency and Efficiency of Shared High-Performance Computing Clusters for Large-scale AI Models," 2023 IEEE Visualization in Data Science (VDS), Melbourne, Australia, 2023, pp. 21-29, doi: 10.1109/VDS60365.2023.00008.
M. Khayyat, I. A. Elgendy, A. Muthanna, A. S. Alshahrani, S. Alharbi and A. Koucheryavy, "Advanced Deep Learning-Based Computational Offloading for Multilevel Vehicular Edge-Cloud Computing Networks," in IEEE Access, vol. 8, pp. 137052-137062, 2020, doi: 10.1109/ACCESS.2020.3011705.
L. Zang, X. Zhang and B. Guo, "Federated Deep Reinforcement Learning for Online Task Offloading and Resource Allocation in WPC-MEC Networks," in IEEE Access, vol. 10, pp. 9856-9867, 2022, doi: 10.1109/ACCESS.2022.3144415.
A. Qadeer and M. J. Lee, "Deep-Deterministic Policy Gradient Based Multi-Resource Allocation in Edge-Cloud System: A Distributed Approach," in IEEE Access, vol. 11, pp. 20381-20398, 2023, doi: 10.1109/ACCESS.2023.3249153.
D. Jia, G. Yuan, X. Lin and N. Mi, "A Data-Loader Tunable Knob to Shorten GPU Idleness for Distributed Deep Learning," 2022 IEEE 15th International Conference on Cloud Computing (CLOUD), Barcelona, Spain, 2022, pp. 449-458, doi: 10.1109/CLOUD55607.2022.00068.
Zabeehullah, F. Arif, Y. Abbas, S. Ahmad and M. Waseem, "DLICA: Deep Learning based novel Strategy for Intelligent Channel Adaption in Wireless SDN-IoT Environment," 2023 International Conference on Communication, Computing and Digital Systems (C-CODE), Islamabad, Pakistan, 2023, pp. 1-6, doi: 10.1109/C-CODE58145.2023.10139910.
Ajani, S. N. ., Khobragade, P. ., Dhone, M. ., Ganguly, B. ., Shelke, N. ., &Parati, N. . (2023). Advancements in Computing: Emerging Trends in Computational Science with Next-Generation Computing. International Journal of Intelligent Systems and Applications in Engineering, 12(7s), 546–559
P. Dai, K. Hu, X. Wu, H. Xing and Z. Yu, "Asynchronous Deep Reinforcement Learning for Data-Driven Task Offloading in MEC-Empowered Vehicular Networks," IEEE INFOCOM 2021 - IEEE Conference on Computer Communications, Vancouver, BC, Canada, 2021, pp. 1-10, doi: 10.1109/INFOCOM42981.2021.9488886.
Y. S. Nasir and D. Guo, "Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks," 2021 IEEE Globecom Workshops (GC Wkshps), Madrid, Spain, 2021, pp. 1-6, doi: 10.1109/GCWkshps52748.2021.9681985.
A. Nouruzi et al., "Smart Resource Allocation Model via Artificial Intelligence in Software Defined 6G Networks," ICC 2023 - IEEE International Conference on Communications, Rome, Italy, 2023, pp. 5141-5146, doi: 10.1109/ICC45041.2023.10279230.
Shete, Dhanashri, and PrashantKhobragade. "An empirical analysis of different data visualization techniques from statistical perspective." AIP Conference Proceedings. Vol. 2839. No. 1. AIP Publishing, 2023.
Q. Chen, Z. You, D. Wen and Z. Zhang, "Enhanced Hybrid Hierarchical Federated Edge Learning Over Heterogeneous Networks," in IEEE Transactions on Vehicular Technology, vol. 72, no. 11, pp. 14601-14614, Nov. 2023, doi: 10.1109/TVT.2023.3287355.
H. Ye and G. Y. Li, "Deep Reinforcement Learning based Distributed Resource Allocation for V2V Broadcasting," 2018 14th International Wireless Communications &Mobile Computing Conference (IWCMC), Limassol, Cyprus, 2018, pp. 440-445, doi: 10.1109/IWCMC.2018.8450518.
Y. Zhang, X. Wang, D. Li and Y. Xu, "Hybrid Multiple Access Resource Allocation based on Multi-agent Deep Transfer Reinforcement Learning," 2022 IEEE 95th Vehicular Technology Conference: (VTC2022-Spring), Helsinki, Finland, 2022, pp. 1-5, doi: 10.1109/VTC2022-Spring54318.2022.9860707.
D. Feng, L. Lu, Y. Yuan-Wu, G. Li, S. Li and G. Feng, "Deviceto-device communications in cellular networks", IEEE Commun. Mag, vol. 52, no. 4, pp. 49-55, Apr. 2014.
Shete, Dhanashri, and PrashantKhobragade. "An empirical analysis of different data visualization techniques from statistical perspective." American Institute of Physics Conference Series. Vol. 2839. No. 1. 2023.
H. Seo, K. D. Lee, S. Yasukawa, Y. Peng and P. Sartori, "LTE evolution for vehicle-to-everything services", IEEE Commun. Mag, vol. 54, no. 6, pp. 22-28, Jun. 2016.
L. Liang, G. Y. Li and W. Xu, "Resource allocation for D2D-enabled vehicular communications", IEEE Trans. Commun, vol. 65, no. 7, pp. 3186-3197, Jul. 2017.
W. Sun, E. G. Strom, F. Brannstrom, K. C. Sou and Y. Sui, "Radio resource management for D2D-based V2V communication", IEEE Trans. Veh. Technol, vol. 65, no. 8, pp. 6636-6650, Aug. 2016.
M. I. Ashraf, M. Bennis, C. Perfecto and W. Saad, "Dynamic proximity-aware resource allocation in Vehicle-to-Vehicle (V2V) communications", Proc. IEEE Globecom Workshops (GC Wkshps), pp. 1-6, Dec. 2016.
Ahmed H. Hamed, & Nouby M. Ghazaly. (2022). A Review of Using Natural Gas in Internal Combustion Engines. International Journal on Recent Technologies in Mechanical and Electrical Engineering, 9(2), 07–12. https://doi.org/10.17762/ijrmee.v9i2.365
B. Bai, W. Chen, K. B. Letaief and Z. Cao, "Low complexity outage optimal distributed channel allocation for vehicle-to-vehicle communications", IEEE J. Sel. Areas Commun, vol. 29, no. 1, pp. 161-172, Jan. 2011.
S.-Y. Ni, Y.-C. Tseng, Y.-S. Chen and J.-P. Sheu, "The broadcast storm problem in a mobile ad hoc network", Proc. ACM/IEEE MobiCom, pp. 151-162, Aug. 1999.
O. Tonguz, N. Wisitpongphan, J. Parikh, F. Bai, P. Mudalige and V. Sadekar, "On the broadcast storm problem in ad hoc wireless networks", Proc. BROADNETS, pp. 1-11, Oct. 2006.
A. Krizhevsky, I. Sutskever and G. E. Hinton, "Imagenet classification with deep convolutional neural networks", Proc. Adv. Neural Inf. Process. Syst, pp. 1097-1105, 2012.
A. Chaoub, M. Giordani, B. Lall, V. Bhatia, A. Kliks, L. Mendes, et al., "6G for Bridging the Digital Divide: Wireless Connectivity to Remote Areas", IEEE Wireless Communications, vol. 29, no. 1, pp. 160-168, 2022.
M. M. Azari, S. Solanki, S. Chatzinotas, O. Kodheli, H. Sallouha, A. Colpaert, et al., "Evolution of Non-Terrestrial Networks From 5G to 6G: A Survey", IEEE Communications Surveys & Tutorials, vol. 24, no. 4, pp. 2633-2672, 2022.
T. C. Nguyen, H.-C. Le, S. Sarang, M. Drieberg and T.-H. T. Nguyen, "Priority and Traffic-Aware Contention-Based Medium Access Control Scheme for Multievent Wireless Sensor Networks", IEEE Access, vol. 10, pp. 87361-87373, 2022.
W. Chen, X. Qiu, T. Cai, H.-N. Dai, Z. Zheng and Y. Zhang, "Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey", IEEE Communications Surveys & Tutorials, vol. 23, no. 3, pp. 1659-1692, 2021.