Skip to content

docs: add GSoC 2026 datalake blog - #129

Merged
zkaoudi merged 2 commits into
apache:mainfrom
JunWang222:blog/gsoc-2026-datalake-friendly
Aug 21, 2026
Merged

zkaoudi merged 2 commits into
apache:mainfrom
JunWang222:blog/gsoc-2026-datalake-friendly

Conversation

@JunWang222

Copy link
Copy Markdown
Contributor

Summary

This PR adds a blog post summarizing the GSoC 2026 project, “Make Apache Wayang More Datalake-Friendly.”

Changes

  • Add the GSoC 2026 datalake-friendly Wayang blog post.
  • Describe the Trino, Presto, BigQuery, DuckDB, and Parquet integrations.
  • Add a project overview image after the introduction.
  • Register Jun Wang as a blog author.
  • Include links to the related Apache Wayang pull requests.

@zkaoudi zkaoudi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you Jun for the post. Just a minor change in the figure please

Apache Wayang lets users describe a data-processing pipeline once and then either choose an execution platform or let Wayang's optimizer decide where the pipeline should run. This matters for modern analytical workloads because data is often no longer stored inside a single database. It may live as Parquet files in object storage, in federated catalogs queried by Trino or Presto, in a serverless warehouse such as BigQuery, or in local analytical files processed by DuckDB. The project focused on making these engines visible to Wayang as execution platforms rather than treating them as separate external connectors.

<div style={{textAlign: 'center'}}>
<img width="90%" alt="Apache Wayang data lake execution platforms project overview" src="/img/blog/wayang-datalake/hero-image.png" />

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you change the "Plan" occurences in the image to "Query plan"? It can seem ambiguous for someone reading for the first time

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your suggestion! And I have modified the image.

@zkaoudi
zkaoudi merged commit c6ee441 into apache:main Aug 21, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants