Importing MYOB receipt details into a SQL database

[tylerlamparter]

It sounds like you're about on the right track. There are a couple patterns you could do here:

• Use the Use SQL query once per page of records or the Use SQL query once per record option on your import to pass data to a stored procedure where it handles everything.
• Have one flow that exports all of your data and uses the Use bulk insert SQL query (recommended) option to load all if to a staging table. After that, use the Next integration flow option in the flow settings to run a second flow after this first flow finishes. The second flow would have a simple export that just exports a single record (by doing select 1 or count(*) from table). Then the import on that second flow triggers a stored procedure or runs a merge/insert/update command.
• If you want a complex pattern to put it all on 1 flow, you could also do this, where you have an import to batch insert to staging, then another import that runs after everything is loaded.

How to wait on a flow step until all records are processed

@Yonton_Mehler asked a great question: “How can I have a flow that takes tens of thousands of records, imports them somewhere like a database or file, then waits on that step until everything is processed before moving on?” We talked through a couple options, and I shared one approach — but I couldn’t resist actually testing it. Here’s what I came up with. Why this matters This is really useful if you need to insert a large batch of records and then run an action after all of those records…