I need to set-up flows to run on a nightly basis to feed data from our Salesforce HealthCloud instance to our AWS S3 datalake. Ideally, I would like to pull the delta on objects (i.e. Accounts, Contacts, etc) nightly, but I am not sure the best approach to pulling all fields from each object. I hav…

Hi Dave. With respect to the "nightly pull", I would use the scheduling feature to pick when you want it to run and then the "Delta" processing feature of the export step. That should handle the frequency that you want. The node would look something like this. [5301043caa20740200000001-79f82a8…

@daveguderian you will have to basically do what you did for HubSpot. Flow 1: Get the list of Salesforce fields on the object you want. You can build a SOQL query to get that, but I've found the REST api is even better because it gives you more data about the fields and lets you know if they are…

Thank you both for the feedback. Tyler- I was able to follow the steps to get the information to flow 2, but I don't understand how to update the SOQL query with the fields (i.e. name) that I am fetching in flow 1. Do I need to change the salesforce connection again in step 2, or can i use a stand…

@daveguderian I'll do you one better. Install this integration zip and it should create as many flows as you need in order to sync over all your Salesforce data to S3. Basically, it has a flow that creates other flows based on the integration settings you put in. It gives you a drop down of Salesfor…

Tyler- Thank you so much for taking the time to put this together. I am trying to get it up and running but am getting some errors. I'm not sure what the error is indicating or if perhaps one of the fields is not appropriately populating prior to hitting the branching? Here is the step I am receiv…

I think I may have figured it out... I changed "sandbox": true and that seemed to work. Any other changes you can think of off hand that I may need to make?

@daveguderian I guess you probably installed this in sandbox? I hadn't thought about that, but it makes sense it failed since I made this in production. Nothing else I can think of.

Thanks Tyler. Looks like I am running into a similar issue on the second to last step on flow 1, but I'm not sure where to make the change on this step. [5301043caa20740200000001-8b6052136a3a4fbe819f2c1b68807c04.png] [5301043caa20740200000001-902a14fb4b0d41419cd270cb5ae98f90.png]

@daveguderian I made some updates and the link should download you the new version. I should have mapped sandbox everywhere because by not mapping sandbox, it defaults to production. So there was a mismatch in what environments resources were being made.

Datalake Salesforce Export

Integrator.io

tylerlamparter (Tyler Lamparter) March 23, 2024, 10:30pm 4

@daveguderian like in this thread: https://connective.celigo.com/t/hubspot-rate-limit/304

Topic		Replies	Views
Salesforce - Data Export error when selecting all fields Integrator.io error-handling , export , salesforce	2	123	December 1, 2023
Hubspot Rate limit Integrator.io rate-limiting , hubspot	19	208	June 11, 2024
Datalake Integration From ZenDesk Integrator.io amazon-s3 , zendesk	4	109	September 25, 2024
Salesforce incorrect date format Integrator.io error-handling , flow-builder , import , filter , salesforce	12	156	November 3, 2023
Netsuite Files to Salesforce Attachments Integrator.io flow-builder , netsuite , file-transfer , export , salesforce	4	145	August 16, 2020

Datalake Salesforce Export

Related topics