Deploying Multi-Cluster/Multi-Region Gateway AND have redundant stateful services with Autopilot?

Google Cloud Serverless Applications
1

For example, I want two clusters to each be in a different region so I have basic region redundancy. Some of the services I want to run are stateful (which includes keeping track of user sessions). I am not looking to maintain state if a cluster fails. I am just wanting a cluster B that I can direct the remaining traffic to if cluster A goes down. I see there are many ways to go about this. I looked at examples in the following links:

The picture in the first link falls short due to it looking like the stateful service is just deployed in a single cluster. I want that stateful service to be deployed in all the clusters and, ideally, if in the event of the cluster failing, I would want all services choosing the next available stateful backend and sticking with it.

The third example looks almost like the setup I’m looking for. It seems that I would only need to do ServiceExport on the user facing services. But I have the following questions:

  1. Requests to the GATEWAY_IP:80 will result in a default page displaying the following message: fault filter abort
    But, the diagram below shows if the user went to store.example.com/* it would redirect to either path. Will store.example.com without trailing slash go to the fail state? Is the fail state only if the actual gateway IP is entered into browser?
  2. If I just specify the path prefix to be / so that all traffic can go to either cluster and so I don’t have to rewrite any site logic that relies on the URL structure, will the gateway service/resource intelligently map user traffic to the correct cluster (by ip address or other) so that if a user’s browser crashes, tab refreshes, user pastes a direct link to a page in a new tab while logged in an existing tab, or just even basic request to request remain at the same cluster as the first request? If not how can I accomplish this?
1 Like
2

Hi @g3289ds ,

Based on the information that you shared, you want to deploy two clusters in different regions on GKE for basic region redundancy. Stateful services, such as user session tracking, should be deployed across both clusters. In the event of a cluster failure, your aim is to reroute traffic to the functional cluster.

From here, you are considering a multi-cluster gateway setup using a load balancer to distribute traffic across clusters.

To address your question, accessing “store.example.com” without a trailing slash may not necessarily result in a failure. The outcome depends on your service configurations. Fail states are usually reserved for errors or issues in the load balancing process, rather than simply accessing the domain without a specific path.

If you choose / as the path, letting all traffic go to any cluster, the load balancer will smartly share the traffic. It always checks if your pods in the clusters are healthy and guides traffic to the good ones. This helps handle problems by sending traffic to healthy parts. Load balancers support session affinity to direct requests from the same client to the same backend instance, ensuring a consistent user experience.

Recommendations:

  • Implement appropriate health checks for your stateful services and clusters.
  • Consider session affinity options provided by the load balancer.
  • Test failover scenarios to ensure seamless transition in case of cluster failures.

By following these considerations, you can set up a strong and reliable multi-cluster system on GKE that ensures your stateful services can recover well in case of any issues.

Let me know if this answers your questions.

1 Like