Skip to content

[requires Camel 4.23.0] Fix #3015: Add LangChain4j document ingestion Kamelets - #3016

Draft
JiriOndrusek wants to merge 1 commit into
apache:mainfrom
JiriOndrusek:feature/ingest-kamelets
Draft

[requires Camel 4.23.0] Fix #3015: Add LangChain4j document ingestion Kamelets#3016
JiriOndrusek wants to merge 1 commit into
apache:mainfrom
JiriOndrusek:feature/ingest-kamelets

Conversation

@JiriOndrusek

Copy link
Copy Markdown

Fixes #3015.

Requires Camel 4.23.0 with apache/camel#26190

Four Kamelets forming the ingestion half of a RAG setup, backed by the new camel-langchain4j-ingest component (CAMEL-24621, apache/camel#26190, Camel 4.23):

  • langchain4j-ingest-sink — splits, batch-embeds and stores documents in a LangChain4j EmbeddingStore, each segment stamped with the pipeline name and document id;
    optional dedup by id and a document size cap
  • tika-extract-text-action / docling-convert-action — generic document→text/markdown parse steps (useful beyond ingestion) that capture the document id before
    the parse, so a crafted document cannot forge its own identity
  • langchain4j-ingest-file-source — a directory source with knowledge-base semantics: files are read, not consumed; edits are re-delivered; parser actions receive the
    raw bytes

Citrus tests cover each Kamelet, the source → action → sink compositions (including a binary PDF) and the file source's register semantics.

⚠️ The integration-tests check is red on purpose: the tests need Camel 4.23+ and fail on the catalog's current 4.22 — the red build is the gate that keeps this PR from
merging into a release line whose Camel cannot run these Kamelets. It turns green with the catalog's move to Camel 4.23. Verified locally with
-Dcamel.version=4.23.0-SNAPSHOT (6/6 passing).

PR prepared by Claude Code on behalf of @JiriOndrusek.

🤖 Generated with Claude Code

The ingestion half of a RAG setup over the camel-langchain4j-ingest
component (Camel 4.23): a sink that splits, batch-embeds and stores
documents with identity metadata and optional dedup; generic Tika and
Docling parse actions that capture the document id before the parse, so
a document cannot forge its own identity; and a file source with
knowledge-base semantics (read without consuming, edits re-delivered,
raw bytes for parsers). Citrus tests cover each Kamelet and the
compositions; they need Camel 4.23+ and fail on older versions by
design, gating the merge until the catalog bumps
(run with -Dcamel.version=4.23.0-SNAPSHOT).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@JiriOndrusek JiriOndrusek changed the title [camel-4.23.0] Fix #3015: Add LangChain4j document ingestion Kamelets [requires Camel 4.23.0] Fix #3015: Add LangChain4j document ingestion Kamelets Sep 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add LangChain4j document ingestion Kamelets

1 participant