SFDC connector in application integration

Google Cloud Integration Services
,
1

Hi @mtalreja @Meenchou ,all , We are working on a use case where we have to connect SalesForce (SFDC) and Bigquery for data transfer. We are trying to use application integration to accomplish this task. We have successfully created the SFDC and Bigquery connector. However, we are not sure if application integration can fulfil our use cases listed below

  1. We have around 30+ objects in SFDC that need to be synced in Bigquery on a schedule. Is it possible to configure only one flow for all the 30+ objects using a custom query in SFDC connector? We would like to provide the query at runtime, which will be stored in the Firestore.

  2. Can transformation task can also be dynamic based on the configurations?

In nutshell, we would like to create one flow for all the SFDC objects and provide the custom query and transformation at run time.

Thanks,

Aditya

2

Hi @adi18ris ,

Welcome to Google Cloud Community!

Application integration with an SFDC connector can handle syncing multiple Salesforce objects to BigQuery with dynamic configurations.

  • Use a single flow with a dynamic query retrieved from Firestore at runtime. The query should be parameterized to handle different object structures.
  • Implement dynamic transformation tasks using conditional logic based on object names or scripting languages to define transformations based on configurations in Firestore.
  • This approach offers benefits like centralized configuration, scalability, and maintainability.
3

Thanks @christianpaula for your response, Could you please point me to a detailed walkthrough of this approach? I tried configuring custom query, but I am not sure how I can provide a dynamic query at the time of execution. Also, how do I implement dynamic transformation task? is this something different from transformation task?