Hi there !
We are building a video streaming application(video analytics) on Google Cloud. We have opted for an “Apache Kafka data streaming architecture” from a design perspective . We have chosen the Google Cloud “Managed Service for Apache Kafka” to host/manage are Kafka clusters. My question to the community : What is the recommended Google Cloud component/product to deploy Python Kafka consumers and producers for our Kafka topics ?
My research so far points to either opting for Google Compute Engine VM or the “Cloud Run Worker Pools”(serverless approach). I am leaning towards the serverless approach and therefore I have chosen to post this question in this specific sub community group . Kindly advice if “Cloud Run Worker Pools” would be the right choice for the deployment of kafka consumers/producers. Or whether a different Google cloud Product/Component would be a better fit for my use case ..thanks in advance !!