I have built a custom flow using an HTTP connector, and the API I am using has a 1000 record limit which you can set in the request body. Is there a way in Celigo without using Javascript to either a) have the export step repeat itself but with a different http request body within a flow or b) have multiple export steps that use the same call but different request body that then append together before the other steps in a flow?
The only way I could think to do so would be to create a copy of the flow within the integration for each 1000 records, so I would have multiple flows that ran in sequence but that seemed like it probably wouldn't be ideal.
Hi @cascadeservicecascad,
Not sure about the details of your use case or your API (maybe you can post here the doc of the API if that's public), but I think you can definitely in the same flow, use multiple exports (by adding sources). The issue with that, is that it will be a static export.
@youssefzouhairi Unfortunately I don't believe it is public. I figured out how to add multiple sources but wasn't sure how to append them together before the lookup/import steps. Is there an online learning or document that goes over that? I looked but it's possible I didn't have the search terms right.
I'm fine with it being static, and just adding a new source each time we add another 1000 records as it doesn't get posted to frequently enough to be an issue.
@cascadeservicecascad you can probably set up a paging mechanism. Maybe use the custom request body option: https://docs.celigo.com/hc/en-us/articles/360059620151-API-pagination