Cloud-Native Micro services Architecture

Authors

  • Sri Harsha Koneru Computer Information Systems and Information Technology, University of Central Missouri, USA. Author
  • Ravi Teja Avireneni Industrial Management, University of Central Missouri, USA. Author
  • Naresh Kiran Kumar Reddy Yelkoti Information Systems Technology and Information Assurance, Wilmington University, USA. Author
  • Siva Prasad Yerneni Khaga Environmental Engineering, University of New Haven, USA. Author

DOI:

https://doi.org/10.63282/3050-9246.IJETCSIT-V2I4P110

Keywords:

Cloud-Native Architecture, Micro services, Containerization, Kubernetes, Docker, AI Workloads, MLOps, Scalability, Resilience, CI/CD, Distributed Systems, Service Orchestration

Abstract

The emergence of cloud-native microservices architecture has redefined how modern AI-driven systems are developed, deployed, and maintained. Unlike traditional monolithic systems, microservices enable modular development, independent scaling, and resilience across distributed environments (Dragoni et al., 2017). With the increasing demand for AI applications, integrating machine learning workloads into containerized and orchestrated microservices environments offers enhanced flexibility and scalability (Kalske, Mäkitalo, & Mikkonen, 2018). Cloud-native ecosystems leverage technologies such as Docker and Kubernetes to facilitate continuous integration and deployment (CI/CD), automated scaling, and fault isolation (Pahl & Jamshidi, 2016). Furthermore, adopting microservices in AI pipelines improves system observability and accelerates model iteration cycles through MLOps practices (Karmakar & Saha, 2020). However, challenges remain in managing data consistency, inter-service communication, and runtime monitoring at scale (Fazio et al., 2020). This research investigates the principles, advantages, and architectural considerations of deploying AI workloads in cloud-native microservices environments to enhance scalability, resilience, and operational efficiency. The findings contribute to understanding how enterprises can leverage microservices and container orchestration for intelligent, adaptive, and high-performing AI systems

Downloads

Download data is not yet available.

References

[1] Dragoni, N., Giazzi, A., Lafuente, A. L., Mazzara, M., Montesi, F., Mustafin, R., & Safina, L. (2017). Microservices: Yesterday, today, and tomorrow. In Present and Ulterior Software Engineering (pp. 195–216). Springer.

[2] Fazio, M., Celesti, A., Puliafito, A., & Villari, M. (2020). A cloud-based architecture for big data stream mobile analytics. IEEE Cloud Computing, 7(2), 20–28.

[3] Kalske, M., Mäkitalo, N., & Mikkonen, T. (2018). Challenges when moving from monolith to microservice architecture. IEEE Software, 35(3), 50–57.

[4] Karmakar, S., & Saha, D. (2020). MLOps: Model management, deployment, and monitoring with microservices. ACM Computing Surveys, 53(5), 1–26.

[5] Pahl, C., & Jamshidi, P. (2016). Microservices: A systematic mapping study. In Proceedings of the 6th International Conference on Cloud Computing and Services Science (pp. 137–146).

[6] Rahman, A., Williams, L., & Barik, T. (2019). The challenges of continuous integration in large-scale agile software development: A case study. Empirical Software Engineering, 24(6), 3144–3180.

[7] Taibi, D., Lenarduzzi, V., & Pahl, C. (2020). Continuous architecting with microservices and DevOps: A systematic mapping study. Journal of Systems and Software, 165, 110569.

[8] Dragoni, N., Giazzi, A., Lafuente, A. L., Mazzara, M., Montesi, F., Mustafin, R., & Safina, L. (2017). Microservices: Yesterday, today, and tomorrow. In Present and Ulterior Software Engineering (pp. 195–216). Springer.

[9] Fazio, M., Celesti, A., Puliafito, A., & Villari, M. (2020). A cloud-based architecture for big data stream mobile analytics. IEEE Cloud Computing, 7(2), 20–28.

[10] Kalske, M., Mäkitalo, N., & Mikkonen, T. (2018). Challenges when moving from monolith to microservice architecture. IEEE Software, 35(3), 50–57.

[11] Karmakar, S., & Saha, D. (2020). MLOps: Model management, deployment, and monitoring with microservices. ACM Computing Surveys, 53(5), 1–26.

[12] Macias, M., & Guitart, J. (2019). SLA-driven elasticity management for cloud applications using the Kubernetes platform. Future Generation Computer Systems, 99, 1–17.

[13] Matsumoto, Y., Saiki, T., & Yoshida, N. (2019). Containerized AI microservices for real-time analytics. Procedia Computer Science, 159, 104–113.

[14] Newman, S. (2015). Building microservices: Designing fine-grained systems. O’Reilly Media.

[15] Pahl, C., & Jamshidi, P. (2016). Microservices: A systematic mapping study. In Proceedings of the 6th International Conference on Cloud Computing and Services Science (pp. 137–146).

[16] Rahman, A., Williams, L., & Barik, T. (2019). The challenges of continuous integration in large-scale agile software development: A case study. Empirical Software Engineering, 24(6), 3144–3180.

[17] Taibi, D., Lenarduzzi, V., & Pahl, C. (2020). Continuous architecting with microservices and DevOps: A systematic mapping study. Journal of Systems and Software, 165, 110569.

[18] Fazio, M., Celesti, A., Puliafito, A., & Villari, M. (2020). A cloud-based architecture for big data stream mobile analytics. IEEE Cloud Computing, 7(2), 20–28.

[19] Kalske, M., Mäkitalo, N., & Mikkonen, T. (2018). Challenges when moving from monolith to microservice architecture. IEEE Software, 35(3), 50–57.

[20] Macias, M., & Guitart, J. (2019). SLA-driven elasticity management for cloud applications using the Kubernetes platform. Future Generation Computer Systems, 99, 1–17.

[21] Pahl, C., & Jamshidi, P. (2016). Microservices: A systematic mapping study. In Proceedings of the 6th International Conference on Cloud Computing and Services Science (pp. 137–146).

[22] Rahman, A., Williams, L., & Barik, T. (2019). The challenges of continuous integration in large-scale agile software development: A case study. Empirical Software Engineering, 24(6), 3144–3180.

[23] Taibi, D., Lenarduzzi, V., & Pahl, C. (2020). Continuous architecting with microservices and DevOps: A systematic mapping study. Journal of Systems and Software, 165, 110569.

[24] Krutthika H. K. & A.R. Aswatha. (2020). FPGA-based design and architecture of network-on-chip router for efficient data propagation. IIOAB Journal, 11(S2), 7–25.

[25] Dragoni, N., Giazzi, A., Lafuente, A. L., Mazzara, M., Montesi, F., Mustafin, R., & Safina, L. (2017). Microservices: Yesterday, today, and tomorrow. In Present and Ulterior Software Engineering (pp. 195–216). Springer.

[26] Fazio, M., Celesti, A., Puliafito, A., & Villari, M. (2020). A cloud-based architecture for big data stream mobile analytics. IEEE Cloud Computing, 7(2), 20–28.

[27] Krutthika H. K. & A.R. Aswatha (2020). Design of efficient FSM-based 3D network-on-chip architecture. International Journal of Engineering Trends and Technology, 68(10), 67–73. https://doi.org/10.14445/22315381/IJETT-V68I10P212

[28] Kalske, M., Mäkitalo, N., & Mikkonen, T. (2018). Challenges when moving from monolith to microservice architecture. IEEE Software, 35(3), 50–57.

[29] Karmakar, S., & Saha, D. (2020). MLOps: Model management, deployment, and monitoring with microservices. ACM Computing Surveys, 53(5), 1–26.

[30] Macias, M., & Guitart, J. (2019). SLA-driven elasticity management for cloud applications using the Kubernetes platform. Future Generation Computer Systems, 99, 1–17.

[31] Pahl, C., & Jamshidi, P. (2016). Microservices: A systematic mapping study. In Proceedings of the 6th International Conference on Cloud Computing and Services Science (pp. 137–146).

[32] Rahman, A., Williams, L., & Barik, T. (2019). The challenges of continuous integration in large-scale agile software development: A case study. Empirical Software Engineering, 24(6), 3144–3180.

[33] Taibi, D., Lenarduzzi, V., & Pahl, C. (2020). Continuous architecting with microservices and DevOps: A systematic mapping study. Journal of Systems and Software, 165, 110569.

[34] Dragoni, N., Giazzi, A., Lafuente, A. L., Mazzara, M., Montesi, F., Mustafin, R., & Safina, L. (2017). Microservices: Yesterday, today, and tomorrow. In Present and Ulterior Software Engineering (pp. 195–216). Springer.

[35] Fazio, M., Celesti, A., Puliafito, A., & Villari, M. (2020). A cloud-based architecture for big data stream mobile analytics. IEEE Cloud Computing, 7(2), 20–28.

[36] Krutthika H. K. & Rajashekhara R. (2019). Network-on-chip: A survey on router design and algorithms. International Journal of Recent Technology and Engineering, 7(6), 1687–1691. https://doi.org/10.35940/ijrte.F2131.037619

[37] Kalske, M., Mäkitalo, N., & Mikkonen, T. (2018). Challenges when moving from monolith to microservice architecture. IEEE Software, 35(3), 50–57.

[38] Karmakar, S., & Saha, D. (2020). MLOps: Model management, deployment, and monitoring with microservices. ACM Computing Surveys, 53(5), 1–26.

[39] Macias, M., & Guitart, J. (2019). SLA-driven elasticity management for cloud applications using the Kubernetes platform. Future Generation Computer Systems, 99, 1–17.

[40] Rahman, A., Williams, L., & Barik, T. (2019). The challenges of continuous integration in large-scale agile software development: A case study. Empirical Software Engineering, 24(6), 3144–3180.

[41] Taibi, D., Lenarduzzi, V., & Pahl, C. (2020). Continuous architecting with microservices and DevOps: A systematic mapping study. Journal of Systems and Software, 165, 110569.

[42] Fazio, M., Celesti, A., Puliafito, A., & Villari, M. (2020). A cloud-based architecture for big data stream mobile analytics. IEEE Cloud Computing, 7(2), 20–28.

[43] Kalske, M., Mäkitalo, N., & Mikkonen, T. (2018). Challenges when moving from monolith to microservice architecture. IEEE Software, 35(3), 50–57.

[44] Karmakar, S., & Saha, D. (2020). MLOps: Model management, deployment, and monitoring with microservices. ACM Computing Surveys, 53(5), 1–26.

[45] Macias, M., & Guitart, J. (2019). SLA-driven elasticity management for cloud applications using the Kubernetes platform. Future Generation Computer Systems, 99, 1–17.

[46] Pahl, C., & Jamshidi, P. (2016). Microservices: A systematic mapping study. In Proceedings of the 6th International Conference on Cloud Computing and Services Science (pp. 137–146).

[47] Taibi, D., Lenarduzzi, V., & Pahl, C. (2020). Continuous architecting with microservices and DevOps: A systematic mapping study. Journal of Systems and Software, 165, 110569.

[48] HK, K. (2020). Design of Efficient FSM Based 3D Network on Chip Architecture. INTERNATIONAL JOURNAL OF ENGINEERING, 68(10), 67-73.

[49] Krutthika, H. K. (2019, October). Modeling of Data Delivery Modes of Next Generation SOC-NOC Router. In 2019 Global Conference for Advancement in Technology (GCAT) (pp. 1-6). IEEE.

[50] Ajay, S., Satya Sai Krishna Mohan G, Rao, S. S., Shaunak, S. B., Krutthika, H. K., Ananda, Y. R., & Jose, J. (2018). Source Hotspot Management in a Mesh Network on Chip. In VDAT (pp. 619-630).

[51] Nair, T. R., & Krutthika, H. K. (2010). An Architectural Approach for Decoding and Distributing Functions in FPUs in a Functional Processor System. arXiv preprint arXiv:1001.3781.

[52] Gopalakrishnan Nair, T. R., & Krutthika, H. K. (2010). An Architectural Approach for Decoding and Distributing Functions in FPUs in a Functional Processor System. arXiv e-prints, arXiv-1001.

Published

2021-12-30

Issue

Section

Articles

How to Cite

1.
Koneru SH, Avireneni RT, Reddy Yelkoti NKK, Yerneni Khaga SP. Cloud-Native Micro services Architecture. IJETCSIT [Internet]. 2021 Dec. 30 [cited 2025 Dec. 12];2(4):86-94. Available from: https://www.ijetcsit.org/index.php/ijetcsit/article/view/492

Similar Articles

1-10 of 384

You may also start an advanced similarity search for this article.