Ibis in Python: Portable Analytics for DuckDB, BigQuery, and Snowflake (2026)
Ibis 12 compiles one Python DataFrame API to DuckDB, BigQuery, Snowflake, and 20+ other backends. A data engineer's practical 2026 walkthrough with trade-offs.
Data Engineering Articles
Delta Lake in Python with delta-rs: Merge, Time Travel, and Z-Order Without Spark (2026)
A hands-on guide to Delta Lake in Python with delta-rs 1.6: install, write and read from pandas/Polars, MERGE upserts, time travel and RESTORE, OPTIMIZE with Z-ORDER, plus a production checklist. No Spark or JVM required.
SQLMesh vs dbt in 2026: Virtual Data Environments, Free Backfills, and When to Switch
Honest 2026 comparison of SQLMesh and dbt: virtual data environments, free backfills, Python models, dbt Fusion, and a real migration framework with code examples.
PyIceberg in Python: A Practical Guide to Apache Iceberg Tables (2026)
PyIceberg 0.9 makes Apache Iceberg tables fully usable from pure Python. Walk through catalog setup, reads, appends, upserts, schema evolution, and time travel, plus how PyIceberg compares with Spark, Delta Lake, and Hudi for 2026 lakehouse work.
Airflow vs Prefect vs Dagster in 2026: Choosing a Python Data Orchestrator
A field-tested comparison of Airflow 3, Prefect 3, and Dagster for Python data pipelines in 2026: dbt integration, partition backfills, testing in pytest, and observability tradeoffs that matter at 3am.
Async ETL in Python: httpx + asyncio to Pandas DataFrames (2026)
Build async ETL pipelines in Python using httpx and asyncio.TaskGroup with Pydantic V2 validation. Working code, retry policy, rate-limit handling, and the pitfalls that bite in production.