Running a Reconciliation

A reconciliation job compares data between two connections. This guide shows you how to create and run one.

Prerequisites

• At least two connections configured in your workspace.
• Queries that return comparable result sets from each source.

Create a reconciliation job

Console

1. Go to Jobs in the sidebar and click New Job.
2. Select the source and target connections.
3. Enter the SQL query for each side.
4. Configure the key columns — the columns used to match rows across sources.
5. Click Save.

DataRecs CLI

datarecs job create \
  --name "daily-balance-check" \
  --source-connection production-mysql \
  --source-query "SELECT id, balance FROM accounts" \
  --target-connection warehouse-postgres \
  --target-query "SELECT id, balance FROM accounts_snapshot" \
  --key-columns id

REST API

curl -X POST https://api.datarecs.com/v1/jobs \
  -H "Authorization: Bearer $DATARECS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "daily-balance-check",
    "sourceConnectionId": "conn_abc123",
    "sourceQuery": "SELECT id, balance FROM accounts",
    "targetConnectionId": "conn_def456",
    "targetQuery": "SELECT id, balance FROM accounts_snapshot",
    "keyColumns": ["id"]
  }'

Run the job

Console

Open the job and click Run Now. Progress is shown in real time.

DataRecs CLI

datarecs job run --name "daily-balance-check"

REST API

curl -X POST https://api.datarecs.com/v1/jobs/job_xyz789/run \
  -H "Authorization: Bearer $DATARECS_API_KEY"

Understanding results

After a run completes, results are categorised as:

Category	Meaning
Match	Row exists in both sources with identical values.
Missing in source	Row exists in target but not in source.
Missing in target	Row exists in source but not in target.
Mismatch	Row exists in both but one or more column values differ.