Stream Stack

A durable stream engine on object storage, with storage, metadata, and protocol as the three primary decoupled layers.

Installation

Java 17+ and Maven. Docker (Optional)

mvn clean package

Quickstart

cp harness/local/.env.example harness/local/.env
docker compose --env-file harness/local/.env \
  -f harness/local/docker-compose.minio.yml \
  -f harness/local/docker-compose.ds.yml \
  up -d --build

Node listens on 127.0.0.1:4437. MinIO, cluster, AWS, and Fly: harness/README.md.

Deployment

Create data and WAL S3 buckets. Copy harness/aws/.env.example to harness/aws/.env and fill AWS_*, DATA_BUCKET, and WAL_BUCKET.

docker compose --env-file harness/aws/.env \
  -f harness/aws/docker-compose.ds.yml \
  up -d --build

Swap docker-compose.ds.yml for docker-compose.s2.yml to run S2 facade. Node listens on 127.0.0.1:4437. Three nodes: harness/aws/docker-compose.cluster.ds.yml.

Multi-node (3 nodes) local cluster (ports 4437–4439):

docker compose --env-file harness/local/.env \
  -f harness/local/docker-compose.minio.yml \
  -f harness/local/docker-compose.cluster.ds.yml \
  up -d --build

License

Apache 2.0.