Required behavior
-
Read the single file (e.g. from SFTP).
-
Group / split records by the
Company Codecolumn (dynamic number of companies — not a fixed list). -
Write one output file per distinct company code, each containing only that company’s rows.
-
Output file naming: each file name should start with the company code, e.g.
{company_code}_data...
What we’ve looked at
We explored standard FTP/SFTP import options, batching, and handlebars-style file names. We need confirmation of the recommended pattern in integrator.io for dynamic N companies → N files when N is not known in advance.
Questions
-
Is there a built-in or documented way to achieve dynamic split-by-column → multiple SFTP files with the naming pattern above?
-
If not native, what is Celigo’s recommended approach (e.g.
preSavePage/postResponseMap, import settings, or hybrid with HTTP/external processor)? -
Any limitations we should plan for (batching, aggregation, filename collisions, page size)?