Thanks so much for your reply- I don’t seem to have the DM option yet on Google Cloud as I joined not long ago.
I think the issue is when assigning the listEntititesNextPageToken to the ListEntitiesPageToken for Shopify it looks like it’s not able to process the token. I keep getting the error 400.
For example, even when simplifying to an integration as below:
the first task of returning 10 runs fine, so does the data mapping but after assigning the nextpagetoken to the page token there seems to be some kind of processing error:
The other variables are part of another integration* and it doesn’t matter the length of time I assign to test this- the error code comes back nonetheless
Thanks for the details. I’ll raise this with engineering and see if we can replicate this and figure it out…hopefully it is something simple. It does look like the Next page token does have a value which you successfully mapped to the List page token input…
Apologies…it looks like the playground is offline. However, the Data Transformer task in Application Integration still has full support for JSonnet. I will investigate if we can get the playground back up and running…it is simply a tool to aid developers in being able to pre-test their JSonnet scripts.
Another alternative is a third party connector like Windsor.ai, which provides a free Shopify connector that handles technical complexities and schema management, eliminating the need to custom code or manage infrastructure, and if you’re integrating multiple data sources, it can consolidate data into a unified BigQuery destination.
