Filter and organize records
Compare data sets
Compares this step's records with another step's and tags each as inserted, deleted, updated or unchanged.
Nodes › LogicOpen in Neblex
- Good for
- Finding what changed
- Role
- Works on the records in a flow
- Find it in
- Nodes › Logic
When to use it
- Today's export should be compared with yesterday's to send only the changes.
- A destination should be reconciled with its source.
- Deleted records must be found even though nothing reports them.
Reach for something else when
Poll for changesWhen the source system can be watched for changes directly.Merge by keyWhen you want to join two sets, not find their differences.
Example
Compare today's product export with yesterday's by sku and send only the inserts and updates to the shop.
How it works
- Settings
- Compare with step; Key fields that identify a record; Fields to compare (empty compares every field); Also pass on unchanged records.
- Output
- One record per key on either side, tagged
_change:insert(only here),delete(only in the other step),update(with_changedlisting the fields that differ) orunchanged. Connect a Branch on_changeto handle each kind. Any number of records works. - Example
- Compare today's product export with yesterday's by
skuand send only the inserts and updates to the shop.
Add it to a flow
- Open the flow from Build › Workflows.
- Open Nodes and find Compare data sets under Logic, or search for it. Click it or drag it onto the canvas.
- Drag from the previous step's output handle to its input, then open its settings with ✎ Edit.
- Run the flow and click the step to see the records it received and produced.
More in Filter and organize records
FilterKeeps only the records that match a condition and drops the rest.Nodes › LogicSortOrders records by a field, ascending or descending.Nodes › LogicKeep first NPasses on only the first records, up to the number you set.Nodes › LogicRemove duplicatesRemoves repeated records, or tags them for review, using exact, fuzzy or phonetic matching.Nodes › LogicSplitTurns one record that holds a list into one record per list item.Nodes › LogicGroup into batchesPacks records into groups of a fixed size, so one call can carry many records.Nodes › Logic