Skip to content

[Planning] Align on corese-benchmark architecture, scope and evaluation goals #6

Description

@remiceres

Summary

Technical alignment meeting and formalization of objectives between team members to define the architecture, scope, experimental protocol, and target metrics of corese-benchmark.

Objectives and Technical Scope

1. Scope and Target Metrics

• Formally decide the core metrics to capture: data ingestion throughput (triples/s), query latency percentiles (p50, p95, p99), memory footprint (peak heap and post-GC retained size), and GC activity.
• Define controlled hardware and JVM parameters required for reproducible execution.

2. Architectural Blueprint

• Agree on the generic multi-engine benchmark architecture, driver interfaces, and output format (JSON/CSV) for reporting.
• Establish milestone priorities between Corese 4 baseline, Corese 5 comparative runs, third-party store integration, and web dashboard presentation.

Acceptance Criteria

[ ] Technical alignment meeting completed between @remiceres and @abdessamad-abdoun.
[ ] Benchmark architecture and experimental protocol documented in docs/benchmark-methodology.md.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

documentationImprovements or additions to documentation

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions