adls

Real-time ADLs and Fall Detection implement TensorFlow

Datagenerator for Data Services

Fluentd output plugin for Azure Datalake Storage Gen2 (append support)

Microsoft Azure Data Lake Storage MCP Server

HDInsight provider for Airflow

Kafka Connect Sink for ADLS Gen2 with SAS auth, Avro support, GZIP compression, and partition-based file batching.

Workshop to build scalable architectures with Azure Data Explorer (ADX)

Tutorial on setup of online and offline feature stores in Azure Machine Learning (Azure ML), using command line interface (Az CLI)

Kafka Connect ADLS - a Kafka Sink connector for ADLS Gen1

Upload data onto different cloud storages by HDFS client

End to end solution for writing USQL data into parquet and setup Presto to query the data

Production-style Azure analytics engineering project for adult social care using ADF, ADLS, Synapse and Power BI.

End-to-end data pipeline that ingests 12 Transfermarkt football datasets (1.9M+ records) into Azure Data Lake, transforms them through a medallion architecture in Databricks Unity Catalog, and serves analyst-ready KPIs to Power BI.

Azure-oriented geospatial data platform standardizing Canadian climate, hydrometric, wildfire, and disaster datasets into validated spatial risk products for Alberta and British Columbia, with Snowflake, dbt, Power BI, and MapLibre GL.

Projeto para Extração de dados de um SQL Server e Carga em um Data Lake Storage Gen2 da Azure (ADLS) usando Airflow Astro CLI e spark para movimentação dos dados entre as camadas tipo medalhão com delta lake.

End-to-end Azure Lakehouse + Operational Analytics demo with IaC (Bicep/ARM), secure data landing (ADLS, Fabric, Synapse), and can’t-mess-it-up automation (Cosmos upserts + DevOps). Scales with skills, satisfies auditors, and proves automation can be boringly reliable (that’s the point). Runs cleanly every time ... even under interview pressure.

End-to-End Azure Data Engineering Pipeline using Azure Data Factory, Databricks, ADLS Gen2, PySpark, and Synapse Analytics for E-Commerce Analytics.

Terraform module for terraform-azure-adls-gen2

🌟 Write records from Kafka to Azure Data Lake Storage Gen2 with this efficient sink connector using SAS authentication and optional GZIP compression.

This project demonstrates a complete, real-world implementation of a modern data engineering pipeline using the Azure cloud ecosystem. Built around the AdventureWorks dataset, the pipeline follows the Medallion Architecture (Bronze → Silver → Gold), enabling structured data refinement from raw ingestion to business-ready insights.