Observability-Driven Serverless Architectures: Intelligent Monitoring for Distributed Microservices
DOI:
https://doi.org/10.63282/3050-9246/ICRTCSIT-112Keywords:
AI-Powered Tracing, Cloud-Native Workloads, Microservices, Observability, Predictive Telemetry, Proactive Healing, Serverless ArchitectureAbstract
This paper delves into the incorporation of observability-driven strategies within serverless architectures, emphasizing the role of intelligent monitoring in distributed microservices. It investigates the application of AI-driven tracing, predictive telemetry, and proactive healing mechanisms in cloud-native workloads. The study evaluates how these technologies bolster system reliability, performance, and scalability in serverless settings. It identifies and addresses key challenges in implementing observability in distributed systems. The research proposes a novel framework for real-time monitoring and automated issue resolution in serverless architectures. Experimental findings reveal notable improvements in system uptime, resource utilization, and incident response times. The paper concludes by reflecting on the implications of these findings for the evolution of cloud computing and microservices management
Downloads
References
[1] C.-F. Fan, A. Jindal, and M. Gerndt, “Microservices vs Serverless: A Performance Comparison on a Cloud-native Web Application,” Scitepress Science Technology, Jan. 2020, pp. 204–215. doi: 10.5220/0009792702040215.
[2] S. Niedermaier, F. Koetter, A. Freymann, and S. Wagner, “On Observability and Monitoring of Distributed Systems – An Industry Interview Study,” Springer, 2019, pp. 36–52. doi: 10.1007/978-3-030-33702-5_3.
[3] G. Bandarupalli, “Enhancing Microservices Performance with AI-Based Load Balancing: A Deep Learning Perspective,” Apr. 09, 2025, Springer Science Business Media Llc. doi: 10.21203/rs.3.rs-6396660/v1.
[4] M. Usman, S. Ferlin, A. Brunstrom, and J. Taheri, “A Survey on Observability of Distributed Edge & Container-Based Microservices,” IEEE Access, vol. 10, pp. 86904–86919, Jan. 2022, doi: 10.1109/access.2022.3193102.
[5] J. Manner, S. Kolb, and G. Wirtz, “Troubleshooting Serverless functions: a combined monitoring and debugging approach,” SICS Softw.-Inensiv. Cyber-Phys. Syst., vol. 34, no. 2–3, pp. 99–104, Feb. 2019, doi: 10.1007/s00450-019-00398-6.
[6] W. Lloyd, B. Zhang, M. Vu, O. David, and G. Leavesley, “Improving Application Migration to Serverless Computing Platforms: Latency Mitigation with Keep-Alive Workloads,” Institute Of Electrical Electronics Engineers, Dec. 2018, pp. 195–200. doi: 10.1109/ucc-companion.2018.00056.
[7] H. Seo et al., “Machine learning techniques for biomedical image segmentation: An overview of technical aspects and introduction to state-of-art applications.,” Medical Physics, vol. 47, no. 5, May 2020, doi: 10.1002/mp.13649.
[8] C. Lee, T. Yang, M. R. Lyu, Z. Chen, and Y. Su, “Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Data,” Institute Of Electrical Electronics Engineers, May 2023, pp. 1750–1762. doi: 10.1109/icse48619.2023.00150.
[9] J. Santos, B. Volckaert, F. D. Turck, and T. Wauters, “gym-hpa: Efficient Auto-Scaling via Reinforcement Learning for Complex Microservice-based Applications in Kubernetes,” Institute Of Electrical Electronics Engineers, May 2023. doi: 10.1109/noms56928.2023.10154298.
[10] X. Hou et al., “AlphaR: Learning-Powered Resource Management for Irregular, Dynamic Microservice Graph,” Institute Of Electrical Electronics Engineers, May 2021. doi: 10.1109/ipdps49936.2021.00089.
[11] S. S. W. Fatima and A. Rahimi, “A Review of Time-Series Forecasting Algorithms for Industrial Manufacturing Systems,” Machines, vol. 12, no. 6, p. 380, June 2024, doi: 10.3390/machines12060380.
[12] Q. Du, T. Xie, and Y. He, “Anomaly Detection and Diagnosis for Container-Based Microservices with Performance Monitoring,” Springer, 2018, pp. 560–572. doi: 10.1007/978-3-030-05063-4_42.
[13] A. Ali, F. Yan, E. Smirni, and R. Pinciroli, “BATCH: Machine Learning Inference Serving on Serverless Platforms with Adaptive Batching,” Institute Of Electrical Electronics Engineers, Nov. 2020, pp. 1–15. doi: 10.1109/sc41405.2020.00073.
[14] F. A. Ezeugwa, “Evaluating the Integration of Edge Computing and Serverless Architectures for Enhancing Scalability and Sustainability in Cloud-based Big Data Management,” J. Eng. Res. Rep., vol. 26, no. 7, pp. 347–365, July 2024, doi: 10.9734/jerr/2024/v26i71214.
[15] J. N. A. M. -, S. P. -, S. V. B. -, and M. D. -, “Enhancing Cloud Compliance: A Machine Learning Approach,” AIJMR, vol. 2, no. 2, Apr. 2024, doi: 10.62127/aijmr.2024.v02i02.1036.
[16] F. Psarommatis, D. Kiritsis, A. Mousavi, and M. Danishvar, “Cost-Based Decision Support System: A Dynamic Cost Estimation of Key Performance Indicators in Manufacturing,” IEEE Trans. Eng. Manage., vol. 71, pp. 702–714, Jan. 2024, doi: 10.1109/tem.2021.3133619.
[17] E. A. Mohan Raparthy, “Predictive Maintenance in IoT Devices using Time Series Analysis and Deep Learning,” dxjb, vol. 35, no. 3, pp. 01–10, Dec. 2023, doi: 10.52783/dxjb.v35.113.
[18] K. R. Kotte, L. Thammareddi, D. Kodi, V. R. Anumolu, A. K. K and S. Joshi, "Integration of Process Optimization and Automation: A Way to AI Powered Digital Transformation," 2025 First International Conference on Advances in Computer Science, Electrical, Electronics, and Communication Technologies (CE2CT), Bhimtal, Nainital, India, 2025, pp. 1133-1138, doi: 10.1109/CE2CT64011.2025.10939966.
[19] B. C. C. Marella, G. C. Vegineni, S. Addanki, E. Ellahi, A. K. K and R. Mandal, "A Comparative Analysis of Artificial Intelligence and Business Intelligence Using Big Data Analytics," 2025 First International Conference on Advances in Computer Science, Electrical, Electronics, and Communication Technologies (CE2CT), Bhimtal, Nainital, India, 2025, pp. 1139-1144, doi: 10.1109/CE2CT64011.2025.10939850.
[20] Thirunagalingam, A. (2024). Transforming real-time data processing: the impact of AutoML on dynamic data pipelines. Available at SSRN 5047601.
[21] Swathi Chundru et al., "Architecting Scalable Data Pipelines for Big Data: A Data Engineering Perspective," IEEE Transactions on Big Data, vol. 9, no. 2, pp. 892-907, August 2024. [Online]. Available: https://www.researchgate.net/publication/387831754_Architecting_Scalable_Data_Pipelines_for_Big_Data_A_Data_Engineering_Perspective.
[22] L. N. R. Mudunuri, “Artificial Intelligence (AI) Powered Matchmaker: Finding Your Ideal Vendor Every Time,” FMDB Transactions on Sustainable Intelligent Networks., vol.1, no.1, pp. 27–39, 2024.
