Data Engineering Tools

Cron, partitioning, throughput, retention and pipeline sizing calculators.

Batch Window Calculator Says whether a job fits its window, and how many rows it takes before it stops fitting.
Cron Schedule Builder Plain English in, cron expression and the next three firing times out.
Data Contract Generator Drafts a YAML or Markdown data contract from a sample, leaving the human decisions as TODOs.
DDL to Data Dictionary Turns CREATE TABLE statements into a Markdown data dictionary, one table per section.
Incremental Load SQL Generator Writes a watermark-based incremental extract query from a CREATE TABLE statement.
Partition Size Calculator Compares every partition grain by size per partition and partition count at full retention.
Retention Policy Calculator Prices a hot, warm, cold and archive retention policy tier by tier.
SCD Type 2 Generator Builds a Type 2 dimension table and its load statement from a CREATE TABLE statement.
Storage Growth Calculator Size and monthly cost projected to five years, with compression, indexes, replicas and retention applied.
Throughput Calculator Daily volume in, sustained rate, peak rate, bandwidth and worker count out.
Processing happens locally in your browser. What you paste or load is processed by this page and is not uploaded to a server. Nothing is stored unless you use a control that says it stores something, and you can clear anything this site has kept from the privacy page.