Hi,
I’m seeing a possible issue with a Discovery Engine ImportDocuments operation from BigQuery. I’m wondering if there is a service disruption at the moment ?
My pipeline has been working for months, but as of today the import has been running for more than 5 hours.
Current behavior:
-
Status:
Import in progress -
Details:
No errors -
BigQuery source was read successfully
-
Discovery Engine created the staged
.jsonfiles -
The operation on one datastore now shows the total document count, but did not for the 1st hour or so.
-
items succeededremains0on one datastore, and at14on a second one. -
No failures are reported, no errors in the cloud bucket or console.
-
I have a structured datastore, and am doing an incremental update.
Because the BigQuery extraction completed and the staged files were created, source permissions seem unlikely to be the issue. It looks like the process may be stuck during the document import/indexing phase, but I have no idea why that might be.
Are there any known delays or issues with Discovery Engine imports at the moment?
The product has been working reliable for me for months now, the only remaining issue is this https://discuss.google.dev/t/vertex-ai-applications-search-completequery-api-returning-empty-array-suggestions/272143/3 but I don’t think autocomplete is related to document imports.
Has anyone seen imports remain in this state for multiple hours and eventually complete successfully? I guess I will find out at some point…
My app is in the global region, and I don’t have any quota or billing issues.
Any guidance would be appreciated.