Service Mesh: The Gateway to Happiness

by | 25.04.2021 | Engineering

Microservices have lead the human race away from monolithic applications to a cloud native landscape. The dominance of microservices (containers) has impacted the modern development environment to be scalable, flexible and continuous. But as the number of microservices increases in a system, few problems creep out and start making things more complex.

Like, imagine having to manage communication between 1000s of microservices manually. It makes you cry? Indeed.

But every problem has a solution, and to save us from the clutches of complexity (Also, I don’t want you to cry), we today would talk about service mesh.

What’s a Service Mesh?

A service mesh is a dedicated piece of infrastructure that helps you to compose many discrete services into one functional application.

what is service mesh?
Service Mesh Source:softwareengineeringdaily

Complex? That’s what definition are meant to be. Let’s understand it clearly in the next section.

Why a Service Mesh?

A cloud native application relies on many microservices, or in a layman way, think of it as a service (no confusing names).

Now in an application, you would have a lot of services. For example, in your amazon app, you would have:

  1. Cart management service – keeps track of what’s in your cart
  2. Recommendation service– helps you buy unnecessary items (quite essential for amazon 😉)
  3. Payment processing service– helps you get these sweet useless credit card points

Yeah, I can continue, but would you like to know about thousands of services on Amazon? Probably not (even if you’re a geek).

PS: For simplicity, I broke down stuff in huge logical chunks. The cart management service has a lot of microservice in it. You see, things are complex out there.

Service Mesh microservices drawback
Microservices and so many microservices Sources: Red Hat

Now, you need each microservice to talk to each other (you as a customer need to know how much money you would have to pay for items in your cart), but how would you do that? Easy way to mention the IP address of the containers into your code. But, now we have a problem.

So, assuming we, the developers, are geeks. We won’t either like to roast our brains with so many microservices and making sure they are connected by manually checking each container and the code.

And If traffic surges and few containers pop up (horizontal scaling), how would you connect them? You can’t possibly hard code all the IP address. Or worse, if some container goes down, how would you re-route the traffic till the replacement arrives? You can’t hard code that again.

We need some dedicated piece of infrastructure to do that while we are dealing with thousands of containers. Well, service mesh is that superhero.

It’s a dedicated piece of infrastructure that helps you compose many services into one functional product. Yeah, the definition makes sense now, and you won’t forget what the service mesh does. (More features just a scroll away)

Cheers! 🥂

The Service Mesh Architecture

If you dissect this mesh, you will find that it consists of two network planes.

Data Plane (Sidecar Proxy)

A sidecar proxy sits next to a microservice and forwards requests to other proxies. They aren’t hardcoded in the business logic present in the microservices and are made so that with APIs’ help, the cluster operators can manage them very easily.

The absence of hardcoding allows the developers to focus on the product and not worry about the networking.

Service Mesh Architecture
Service Mesh Architecture Source: Nginx

Control Plane

It helps you inject the Sidecar proxy (the policy and configuration) to the microservices without caring about anything else.

The Control Plane with the Data Plane forms the Service Mesh.

Advantages of Service Mesh

Features provide you with advantages, and let’s talk about the benefits we get using a service mesh.

Service Discovery

It’s complex to hard code IP addresses of different services as restarting and provisioning resources change the IP address on the cloud. Service Mesh helps you with facilitating a service registry. In a service registry, each client talks and register itself and makes sure the system can talk to each other in every scenario.


When you use a service mesh, you take control of your traffic. Now you can channel your users traffic to different versions of the deployments and facilitate A/B testing (Canary Deploys). While deploying a new release, you can also divert the traffic to a backup service (Rolling Deploys).

All these load balancing without hampering the user experience🤯

Load Balancing

As seen, service mesh helps you get granular control and manages the incoming traffic. You can always use that to your advantage and keep your system fully functional.

Distributed Tracing

With the help of trace id, you can assign a unique id to every incoming network traffic and debug the whole product when needed.


For TLS communication between services, Service Mesh provides a certificate authority that generates a per-service certificate.

Also, you can make sure the services are not talking to something they aren’t meant to with the help of tracing. Security 💯

Happy Developers 👨‍💻

Developers are focused on building the business logic, and the service mesh manages networking plus connectivity. I guess this makes them happy. Thinking of networking configuration alongside business logic builds makes me sad.

Final Thoughts 🥱

Service Mesh is a great technology that makes your life simple and secure. If you are interested to know more about the underlying technologies that the service mesh governs, I am attaching few posts down here.

And if you want to know about few of the popular service mesh. Here you go:

Don’t forget to implement them and make your developer’s life easy.

PS: We love making a developer’s life easier. Feel free to reach out to us if you want us to help you with a service mesh implementation 😉

Happy Learning!

Join the Community

The DevOps Awareness Program

Subscribe to the newsletter

Join 100+ cloud native ethusiasts


Join the community Slack

Discuss all things Kubernetes, DevOps and Cloud Native

More stories from our blog

Linkerd: Looming on Service Meshes

Linkerd: Looming on Service Meshes

Microservices and service meshes have become a staple of the industry as companies realize the full potential of creating an independent architecture that allows for easier scale up, agile development, resilience and streamlined deployment. Many of these applications...

What’s new in Flux v0.17.0?

What’s new in Flux v0.17.0?

Flux2 came with its new update a while ago, and it is sheer exciting for the users because it brought a lot of new features. It also made a lot of new enhancements and updates. We will take a look at the entire catalogue in this article. So, without further a due,...

What’s new in Portainer v2.7.0 BE?

What’s new in Portainer v2.7.0 BE?

A few days ago, Portainer Business Edition came up with their new update. It is quite a massive update with many new features, bug fixes, enhancements and much more. In this article, we will see all of those in a nutshell. Let's start What is Portainer? Portainer is...

DVC (Git For Data): A Complete Intro

DVC (Git For Data): A Complete Intro

As a data scientist or ML engineer, have you ever faced the inconvenience of experimenting with the model? When we train the model, the model file is generated. Now, if you want to experiment with some different parameters or data, generally people rename the existing...

Recap of the Cloud Native Meetup Saar #3

Recap of the Cloud Native Meetup Saar #3

We are looking back on a very successful third edition of our Cloud Native Meetup Saar #3! Togetherer with our co-host anynines, we enjoyed a fun afternoon filled with great speakers, intriguing topics and thoughtful conversations! We welcomed a total of three...

Portainer Ambassador Series ft. Fabian Peter

Portainer Ambassador Series ft. Fabian Peter

Portainer arranged a fun and informative discussion through a one-hour special named “Ambassador Series” on 1st July 2021. It was pretty amazing to see Savannah Peterson as the host and two other guests. One is our very own CEO of, Fabian Peter and the other...

What’s new in Longhorn v1.2.0?

What’s new in Longhorn v1.2.0?

Longhorn came with their new update. It is full of surprises. We will peel off one by one to see all the latest updates, features, bug fixes and much more. This one is a much-awaited update, and we will see all of it in a moment. So, without further a due, let's...

Kubernetes Stateful Friend: What’s more to etcd?

Kubernetes Stateful Friend: What’s more to etcd?

The Kubernetes control plane consists of various components, and one of such components is etcd. Anyone starting to learn k8s come across it and memorizes quickly that it’s a key-value pair for Kubernetes with persistence store. But, what’s more to it? Why do we need...

What’s New in Flux 1.24.0?

What’s New in Flux 1.24.0?

Flux 1.24 is out this month with couple of updates and Important notices. Let’s get around what are the updates in the new release. But, first, let’s do a quick intro on Flux. What is Flux? Flux is a tool that checks to see if the status of a cluster matches the git...

Event Driven Architecture Demystified (For Pros)

Event Driven Architecture Demystified (For Pros)

Event-Driven Architecture or EDA is talked about with pride inside any organization. But, through last few months, I have noticed a trend that the definition of EDA is not consistent across people and organizations. It’s vague. EDA is something where you have events...

Interested in what we do? Looking for help? Wanna talk about software strategy?