Control the run
Assert Data Quality
Checks the batch against your rules and stops with precise details when one fails.
Nodes › LogicOpen in Neblex
- Good for
- Protecting destinations from bad data
- Role
- Works on the records in a flow
- Find it in
- Nodes › Logic
When to use it
- Destinations must never receive empty, incomplete or out-of-range data.
- Bad batches should go to a repair path with clear reasons.
Reach for something else when
FilterWhen invalid records can simply be left out.Validate RecordsWhen each record should be checked and routed by result instead of stopping the run.
Example
Before loading a price list, require at least one row, a SKU on every row and prices above zero.
How it works
- Settings
- Checks (at least one): Row count between (min, max) [min 1], Required fields, Numeric range (field, min, max), Condition on every record.
- Output
- Records pass through unchanged when every check passes; otherwise the step fails with assert failed (N violations): ... listing up to five. Set On error to Route to handle it in the flow.
Add it to a flow
- Open the flow from Build › Workflows.
- Open Nodes and find Assert Data Quality under Logic, or search for it. Click it or drag it onto the canvas.
- Drag from the previous step's output handle to its input, then open its settings with ✎ Edit.
- Run the flow and click the step to see the records it received and produced.
More in Control the run
LoopRepeats a group of steps for each record, a set number of times, or while or until a condition holds.Nodes › LogicRun another flowRuns another flow as a reusable sub-flow and continues with its result.Nodes › LogicWaitPauses for a set time before passing records on.Nodes › LogicWait for eventPauses the run until a matching event arrives, then continues with its data.Nodes › LogicSet valueSaves a named value that later steps in the same run can read.Nodes › LogicValidate RecordsChecks each record against a JSON Schema and tags it valid or invalid.Nodes › Logic