Py Data

Have you ever woken up to a production alert, only to discover a critical dashboard or a core ML model is spewing garbage, all because an upstrea…

Have you ever felt that gnawing frustration watching your Spark jobs crawl, with the 'Shuffle Write' and 'Shuffle Read' metrics o…

Remember that frantic 3 AM pager duty call? The one where a critical dashboard went dark, all because an upstream team silently changed a column …

Have you ever felt like you're playing whack-a-mole with your data pipeline, constantly patching for late-arriving records or unexpected sche…

Picture this: you've meticulously built a data pipeline, perhaps even using Pydantic for robust schema validation on incoming API data, just…

Designing a hybrid data warehouse architecture that combines the auditable history and integration flexibility of Data Vault 2.0 with the analyti…

Have you ever spent hours manually sifting through Nepal Rastra Bank's (NRB) Quarterly Economic Bulletins, painstakingly copying numbers from…

As a data engineer working with multiple data sources, I've often struggled with data discovery, governance, and management due to the comple…

Financial analysts and data scientists in Nepal often struggle to access and analyze the quarterly reports published by the Nepal Rastra Bank, wh…

As a data engineer, have you ever struggled to choose the right file format for your data lake, only to find that your choice led to inefficient …

Have you ever found yourself drowning in a sea of data, struggling to find the right dataset or understand the context of a particular piece of i…

Data engineers and data scientists frequently encounter the architectural dilemma of ETL versus ELT when integrating data from external APIs. Thi…