Engineering Semantic Anomaly Detection with Isolation Forests on Live Blog Feeds
Have you ever found yourself staring at a stream of incoming data, perhaps from a critical API endpoint or an internal log system, and wondered, &q…
Posts
How to Build an Atomic Iceberg Lakehouse Pipeline with Polars and PyIceberg
Have you ever watched an automated ETL pipeline silently corrupt a production data lake because two writers tried to drop a partition directory at …
Beyond P-Values: Engineering Sequential Hypothesis Testing Pipelines with Real-World API Streams
When I first started pulling data from the Random User API for a demographic study, I kept getting “significant” results even after the sample size…
From Cloudflare Blog to Data Lake: Building a Production‑Ready Airflow Pipeline with Polars
When I first tried to surface Cloudflare’s daily blog updates for my analytics team, the naïve “fetch‑transform‑load” script I wrote kept re‑proces…
Detecting the Silent Killers: Production Data & Prediction Drift with Evidently AI on Discord RSS Feeds
When I first deployed a text‑classifier to tag Discord Engineering posts as “update” or “general”, I thought I’d nailed the problem. Weeks later, t…