I’m looking to build a simple dashboard in google sheets that will capture a log of certain exports and imports for non-Celigo users to consume. Are there built-in variables or functions that can return the number of successes and errors processed by a specific export or import for a specific flow run? Or would this all have to be custom coded with scripts? I thought I could do this with the Integrator API but I’m not seeing it. The idea is to add this as a step to the flow and generate a summary that would be mapped and imported to a Google Sheet.
Hi @chrishuovinen ... I believe you are looking for the jobs endpoint:
https://docs.celigo.com/hc/en-us/articles/7709208437275-Jobs-API-endpoints#job-api-examples-2
You can query to it with your flow id and other parameters to get to the latest runs that you are interested in.
---Tony
1 Like
Thanks Tony! I must have skipped over that endpoint. I’m looking at it now and it’s close to what I’m looking for. If I send a request for a specific export id, it returns the total number of records processed for all steps in the flow instead of the number of records for each step, like you see in the run history for a flow. I would expect to see all records processed if I requested it by flow id. The export I requested in the screenshot below was actually only 88 records which is what I’m trying to capture, not the total for the flow. Also if I request it by import id, I only get ‘retry’ job types and doesn’t show me the number of successful records processed for the step.
Is there a way to break it down by step from the API?
@chrishuovinen, it's probably helpful to lay out some Celigo job fundamentals here. When you run a flow, you get a parent job where the type is flow. For that given parent job, each flow step gets a child job where the type is import or export. On the child jobs, there is a field called _parentJobId which tells you which parent job the child belongs to. The last type of job is a retry type, and it's essentially the same as flow, where it's a parent level job, and then all the child jobs that process for that parent retry fill out the same.
So, if you're trying to filter to just flow types, you can add another query parameter for type=flow.
2 Likes
Tyler, that is very helpful context. Looks like I have everything I need now. Thank you!
2 Likes