Skip to content

feat: Add Tantivy FON search MVP - #1

Open
Fuyeors wants to merge 9 commits into
mainfrom
feat/spp-tantivy-search
Open

feat: Add Tantivy FON search MVP#1
Fuyeors wants to merge 9 commits into
mainfrom
feat/spp-tantivy-search

Conversation

@Fuyeors

@Fuyeors Fuyeors commented Aug 27, 2026

Copy link
Copy Markdown
Member

Summary

  • Add an Axum search API backed by Tantivy 0.26.1 and a Jieba-based Chinese tokenizer.
  • Parse the current fon-parser main-branch AST for mapping, sitemap, and content FON resources.
  • Materialize sitemap bindings into concrete FRL URLs, apply title fallbacks, keep image values as remote URL pointers, and treat content as plain text/Markdown.
  • Add repository-level FON mock data and a dependency-free CSR search console with rebuild, pagination, and infinite-scroll loading.

Verification

  • cargo fmt --all -- --check
  • cargo test --workspace — 5 tests passed
  • cargo clippy --workspace --all-targets -- -D warnings
  • cargo build --workspace --release
  • Browser smoke test: rebuilt 5 documents from 3 mappings and returned 2 results for 搜索引擎.

This is an MVP for local/mock ingestion. Remote fetching, robots.txt handling, conditional HTTP requests, persistent crawl state, and production multi-tenant controls remain follow-up work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant