A curated collection of free, open-source, and real-world datasets for practicing Data Engineering, Analytics Engineering, SQL, Python, dbt, Apache Spark, Snowflake, BigQuery, Amazon Redshift, Azure Synapse Analytics, DuckDB, Polars, ETL/ELT pipelines, Data Warehousing, Data Lakes, Data Modeling, and modern cloud data platform projects.
This repository is a centralized collection of high-quality datasets for learning, experimenting, and building real-world Data Engineering and Analytics Engineering projects. Instead of searching for datasets every time you start a new project, you can find them all in one place.
Whether you're learning SQL, building ETL pipelines, modeling data warehouses, practicing dbt, working with Apache Spark, or exploring modern cloud data platforms, this repository provides datasets across multiple industries and use cases to support hands-on learning.
This repository contains datasets from various domains, including:
- Retail
- E-commerce
- Finance
- Banking
- Healthcare
- Marketing
- Logistics
- Transportation
- Manufacturing
- Telecommunications
- Government
- Education
- Sports
- Weather
- Social Media
- IoT
- Synthetic Data
Datasets are available in multiple formats such as CSV, Parquet, JSON, Excel, SQL dumps, and other commonly used data formats.
These datasets can be used to practice and build projects involving:
- SQL and Database Development
- Python Data Processing
- Pandas, Polars, and DuckDB
- Apache Spark and PySpark
- dbt Projects
- ETL and ELT Pipelines
- Data Warehousing
- Data Lakes
- Dimensional Modeling
- Analytics Engineering
- Business Intelligence
- Data Quality Testing
- Dashboard Development
- Portfolio Projects
- Interview Preparation
Contributions are always welcome. If you know of a high-quality public dataset that would benefit the Data Engineering community, feel free to open an Issue or submit a Pull Request.
This repository does not claim ownership of the datasets. Each dataset belongs to its original source and is subject to its respective license and terms of use. Please review the original dataset license before using it in personal, educational, or commercial projects.
⭐ If you find this repository helpful, consider giving it a star and sharing it with others in the Data Engineering community.