How to add new source before existing source in a existing DataFlow

Hi all,

In Celigo Integrator.io, I have a data flow where the first step, named DF13.1, uses hard-coded parameters to execute a SQL MI stored procedure. My requirement is to remove these hard-coded parameters and create a new step, DF13.0, which will call another SQL MI stored procedure to retrieve data and pass it to DF13.1. I have added DF13.0 as a new source, but I do not see how to link it with DF13.1 (the existing first step, which will now become the second step). Currently, the source for DF13.1 is set to a SQL query, and I do not see an option to change the source from SQL query to something else.

Can someone guide me on how to link DF13.0 with DF13.1 and update DF13.1 to use the output from DF13.0?

TIA,

Shahzad.

Hi Shahzad,

Thanks for reaching out! After setting DF 13.0 as your new source, you can remove DF13.1 as a source and instead insert it as a lookup step right after DF13.0. You can do this by clicking the + Icon in between the bubbles, then "Add destination / lookup" here:


From here you'll want to select Lookup additional records (per record)

From within the lookup configuration, you will be able to use the parameters from DF 13.0, and also configure DF13.1 results through the lookup step's results mappings as they pass downstream.

Please feel free to give that a try to see if it works out for you.
Simon

1 Like