Hi All,
I have created several Dataflow jobs which run with success.
But I don’t see my assets and Field level data lineage in Dataplex
As well I did try the Datafusion. I see Field level data lineage in UI:
But don’t have any in Dataplex.
I did try to use REST and Java APIs but have got empty response.
If you would like to see the screenshots of my configuration (Permissions,Allowed APIs..) I could put it there.
Do you have any idea what is wrong ?
Your image shows an empty Dataplex Catalog search and not necessarily the lineage for any specific entry in the catalog. Let’s see if we can’t contemplate this a little deeper. I am imagining a Dataflow job that reads from a source, transforms and writes to a destination. Let’s start there. What are the sources and destinations? Do you see catalog entries for those?
Hello Kolban, Thanks for explanation.
1.Actually I have got the Lineage using REST API. But it does not seems correct. There is my post: https://stackoverflow.com/questions/79800349/wrong-rest-response-for-retrieving-column-level-lineage-in-gcp-bigquery
Thanks,
Sergiy
I asked around and apparently Dataplex Column Level Lineage access from the APIs (including REST) is NOT yet available but is hoped to be released in 1Q 2026. As such, althought we see lineage data in the Dataplex UIs, we don’t yet have a valid way to retrieve it for other purposes.
As for Data Fusion emiting Dataplex Lineage data, I came across this article:
View lineage in Dataplex Universal Catalog | Cloud Data Fusion | Google Cloud Documentation
This seems to list the plugins to Data Fusion which claim to support lineage.
Kolban, Thank you for the clarification. Now, all we can do is wait for the release.
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.
