Data Tools¶
Data Tools is the hub for everything that goes into a pipeline: the SQL you write, the schemas that describe your data, and the tests that gate a deployment.
The three cards¶
| Card | Contains |
|---|---|
| Data | SQL data steps — the building blocks of every pipeline |
| Schemas | Tables and columns indexed from your connections |
| Tests | Fixtures and assertions that gate promotion to production |
Each card shows a count and the most recently edited items, so you can get back to what you were working on without navigating.
The Tools menu¶
The Tools ▾ button offers the two ways to create something:
- SQL Modeling — a new SQL data step.
- Ingest Files — upload a CSV, Parquet or JSON file and land it in a table. See Ingest Files.
Queries and migrations¶
A data step is one of two kinds, switchable from the editor toolbar:
- Query — runs on every pipeline execution.
- Migration — DDL. Runs every time in QA so you can iterate, and exactly once per environment in production, tracked on your own database.
The list at Data Tools → Data has an All | Queries | Migrations filter.