Data cleaning pipeline

name: data-cleaning-pipeline
description: "A safe routine to profile, clean and validate a dataset, with a log of every change."
inputs:
  - "data file"
steps:
  - id: 1
    name: "Profile"
    do: "Report rows, columns, types, missing values and duplicates."
  - id: 2
    name: "Plan"
    do: "List fixes and what each changes."
  - id: 3
    name: "Clean"
    do: "Apply fixes to a copy of the data."
  - id: 4
    name: "Validate"
    do: "Compare counts and spot-check rows."
  - id: 5
    name: "Log"
    do: "Write the change log."
output: "A cleaned file, a script and a change log."

How to use it

1. Copy or download the file.
2. Give it to your AI assistant with your inputs, or follow the steps yourself.
3. Check the result of each step before moving to the next.

Try it

Clean this customer export.

Copy prompt