Skip to content
View DarrenDavy12's full-sized avatar
📘
Learning
📘
Learning
1 follower · 2 following

Block or report DarrenDavy12

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
DarrenDavy12/README.md

Hey, I'm Darren👋 Aspiring Data Engineer based in the UK (United Kingdom) — building production-ready data pipelines with a focus on the Microsoft Azure ecosystem. I'm self-driven, project-led, and serious about writing clean, secure, and scalable data infrastructure. Currently open to entry-level, junior and mid-level Data Engineering opportunities.

📌 Featured Projects

Check my pinned repositories below — each one includes a full README with architecture diagrams, design decisions, and notes on what I'd improve in a production setting.

📫 Reach me on email: darrendavy05@gmail.com

🔧 What I Work With and 🔭 currently working on:

Cloud & Infrastructure

Microsoft Azure — Data Factory, Azure Data Lake, Synapse Analytics, Databricks, Fabric Azure Key Vault · RBAC · Managed Identities · Service Principal · Private Endpoints Azure DevOps · CI/CD Pipelines

Data Engineering

Python · SQL · PySpark ETL/ELT Pipeline Design Data Governance & Security (Microsoft Purview, Azure Policy) Medallion Architecture (Bronze / Silver / Gold)

Supporting Stack

Git & GitHub · Docker · Terraform REST APIs · JSON · Parquet

🌱 Currently Focusing On

Implementing security and governance layers into pipelines — Key Vault, RBAC, data lineage
Azure DevOps and CI/CD Pipelines
Data Visualization with Power BI
Deepening expertise in Azure-native architecture patterns
Building projects that reflect real enterprise standards
Learning Azure Databricks & obtaining DP-750 Implementing Data Engineering Solutions Using Azure Databricks

Pinned Loading

  1. supermarket-retail-data-project supermarket-retail-data-project Public

    🚀📊 This project demonstrates a complete ETL pipeline for retail sales data using ☁️ Azure Databricks, 📦 ADLS Gen2, and PySpark, following the 🟫 Bronze → 🟦 Silver → 🟨 Gold architecture.

    Jupyter Notebook

  2. crypto-fabric-pipeline crypto-fabric-pipeline Public

    💹 Top 100 Cryptocurrencies Daily Data Pipeline | End-to-end data engineering workflow with Fabric Lakehouse & Power BI dashboards

    Python

  3. nba2k25-pipeline nba2k25-pipeline Public

    🏀 NBA 2K25 Player Data Pipeline | Extract, transform & load player stats into PostgreSQL + interactive Plotly/Dash analytics 📊

    Python

  4. heart-disease-DE-role-analysis heart-disease-DE-role-analysis Public

    🩺❤️ This mini-project demonstrates a data engineering workflow using Python and Pandas. It processes a Heart Disease dataset to explore patient data, including counts, average age, and grouped metr…

    Python

  5. building-a-lakehouse-in-microsoft-fabric-with-azure-cli building-a-lakehouse-in-microsoft-fabric-with-azure-cli Public

    🏗️🌊 This project a creation of a fully functional Lakehouse in Microsoft Fabric using Azure CLI and other tools. A Lakehouse combines the flexibility of a data lake with the analytical capabilities…

    1

  6. airflow-products-project airflow-products-project Public

    🐳 🛠️🚀 A containerized end-to-end ETL pipeline built with Apache Airflow, Python, Pandas, Docker, and Postgres. The pipeline extracts product data from CSV, applies transformations and data cleaning…

    Python