Cloud DNS sporadic issue

Google Cloud Compute Infrastructure
1

Hello,

We are having small hiccups using Cloud DNS in GKE cluster with Cluster Scope.
At least once a week we get high latency DNS query.

Here are screenshots of the issue from a pcap in Wireshark.

Sorted by DNS time:

ventsislavg_0-1728656705148.png
ventsislavg_0-1728656705148.png3190×2080 1.12 MB

Stats:

ventsislavg_1-1728656725995.png
ventsislavg_1-1728656725995.png1730×1780 391 KB

Sorted by time of day:

ventsislavg_2-1728656734410.png
ventsislavg_2-1728656734410.png3078×2086 1.01 MB

There are no errors from the gke-metadata-server pods in the cluster, nor in the dns_query logs in the Logs Explorer.

Here are dns_query logs filtered by vmInstanceName and the specific A record query. We see two, one of which seems a bit earlier than what we see in Wireshark and can be from another service in the same Node. The second entry is just 9ms after we see it in the packet capture.

ventsislavg_3-1728657369651.png
ventsislavg_3-1728657369651.png1236×360 31 KB

We have a very low timeout requirements and having a sporadic ~2s dns query causes failures.
Is there something more we can investigate and what are the recommended steps to mitigate this?

2 Likes
2

Hi @ventsislavg ,

Welcome to Google Cloud Community!

It appears that a more thorough investigation for your project is necessary. For more detailed insights you may reach out to Google Cloud Support for assistance. Our 1:1 support team has specialized expertise in diagnosing underlying problems. When contacting them, provide all your comprehensive details and screenshots. This will help our 1:1 support team better understand and address your issue.

I hope this helps!