Retrieve media file from URL provided in FTP export

Integrator.io
1

Hello! We’re building an integration that exports media data from an FTP server and imports the retrieved files to Shopify using their stagedUploadsCreate API workflow. In the export data we retrieve the URL of the file we’d like to upload. What I’m not figuring out is how to just make the call to that URL. I see plenty of examples using an HTTP connection (which requires some kind of connection, which isn’t really necessary here) to retrieve the data and store it in the “Path to file URLs” field under “Non-standard API response patterns” but this option doesn’t exist for FTP exports. Also, the data is coming in from the export, I don’t see a way to use this data because the “Path to file URLs'“ field is populated from response data and the data already exists in the paged record.

I also saw another example (admittedly, AI generated) that sets up a second export with a templated Relative URI and this export is programmatically called from a javascript hook to retrieve the file and push the data into the paged data. This seems like a lot of scaffolding just to get at a file (again, it’s AI generated so I’m taking it for what it is). I literally can drop the URL we receive from FTP into a browser or Postman and retrieve the file, so both of these approaches seem overkill. Is there no way to simply pull the file given a URL? I feel like I’m missing something here.

Also, asking a second question, the files we’re retrieving are large; e.g. one file is a 45MB video (Postman reports it as 34MB base64 encoded). How does this work with the 5MB page size limit? From what I’ve read it won’t.

Thanks!

2

This a bit of a work around, but you can do it by utilizing option 2 here:

3

Thanks @tylerlamparter! Sorry for the late reply, it’s been a week. I’ll take a look at this and let you know if I need further assistance.

Thanks!