Compute operations are optimized by Dremel, Which serves as the query engine of BigQuery.
if there is compute crunch, will Dremel automatically increase the number of compute nodes on its own, is that’s what the above line saying? or is the scaling up/down of compute resources is done by Borg, google’s cluster manager?
Hi @Android_Wala,
To answer your question, when handling large or complex queries that require additional compute capacity, Borg is responsible for allocating the required resources. Dremel, as BigQuery’s query execution engine, then uses those resources to efficiently execute and optimize the query logic.
For more detailed information, you may refer to BigQuery under the hood and you can watch this YouTube video to better understand the BigQuery architecture.