Skip to content

[OMEGA-400] import-kb | add ASI Cloud embeddings support - #344

Open
paul-v-snet wants to merge 6 commits into
mainfrom
asi_cloud_as_embedding_provider_support
Open

paul-v-snet wants to merge 6 commits into
mainfrom
asi_cloud_as_embedding_provider_support

Conversation

@paul-v-snet

Copy link
Copy Markdown
Collaborator

Description

  • Added ASI Cloud support as an embedding provider (both for the initial knowledge import and the src/rag.py module)*
  • Updated all relevant documentation in docs/
  • Updated autotests
  • Added a new config value - embeddingModel
  • Updated the import-kb dependency to 0.2.4**

*This PR supersedes #333
**0.2.4 has not been published yet. This PR must be merged only after import-kb version 0.2.4 is published.

How Has This Been Tested?

Tested with the updated import-kb version 0.2.4. Knowledge imports were successfully completed using all three supported embedding providers: Local, OpenAI, and ASI Cloud. The same providers were successfully tested with the src/rag.py module.

Checklist

  • PR contains autogenerated code
  • Self-review completed
  • Test scenarios above are passed with the version of the code from PR

@paul-v-snet

Copy link
Copy Markdown
Collaborator Author

The tests are failing because the new import-kb version has not been published yet - this is expected and does not block the review.

@alyona-snet
alyona-snet requested review from sassless and removed request for alyona-snet September 8, 2026 15:10
Comment thread src/loop.metta Outdated
@TossSky

TossSky commented Sep 16, 2026

Copy link
Copy Markdown
Collaborator

Tested: 9870791, embeddings on ASICloud, OpenAI and Local, container started with docker run.

Works:

  • With embeddingModel=WhereIsAI/UAE-Large-V1 memory goes through ASI Cloud: the stored vector matches ASI Cloud's embedding of the same text, and query returns the stored fact
  • Knowledge-base import on start with ASICloud: 27882 records in 56 requests, no rate-limit errors, and query returns knowledge-base text
  • A missing or rejected ASI_API_KEY stops the container at start with a clear error. No sentinel is written, so the next start tries again
  • OpenAI and Local embeddings still work, and run_mandatory passes

Doesn't work:

  • embeddingprovider=ASICloud without embeddingModel breaks memory. The default is text-embedding-3-large (config.yaml#L42, reference-configuration.md#L37), and ASI Cloud answers 400 Model not found: for embeddings it serves only WhereIsAI/UAE-Large-V1 and BAAI/bge-base-en-v1.5. Every remember and query fails, while the knowledge-base import with the same settings succeeds, because import-kb falls back to UAE on its own. The agent gets RuntimeError (<py_RuntimeError>(0x…)), and nothing in the log says why (rag.py#L150-L153)
  • A memory archive imported on start under ASICloud gets re-embedded with the local e5 model (storage.py#L183-L190, called from entrypoint.sh#L76-L82). The import sends nothing to ASI Cloud, and queries use UAE vectors, so once the knowledge base is loaded the imported fact is not in the top 20 results even for its own text
  • /memory-export under ASICloud answers Memory export failed: Unsupported embedding provider: 'ASICloud' (memory_export.py#L52-L54)
  • Autotests/import_knowledge/test_import_knowledge.py fails after this change: 15 passed before it, 14 passed and 1 failed now. Line 65 expects import-knowledge with no arguments for OpenAI, and the script now passes --provider openai. The file is in neither run_mandatory nor run_optional, so CI never runs it
  • README still says EMBEDDING_PROVIDER is OpenAI or Local

scripts/omega sets embeddingprovider=Local for -p ASICloud, so ASICloud embeddings can only be enabled with docker run. That is what the review of #333 asked for, so I am not reporting it as a defect.

I opened #352 with fixes for all of the above. It targets this PR's branch, and the import-kb script tests are registered in run_mandatory there, so CI runs them from now on. Please review it and merge it into this branch if it looks fine.

Verdict: FAIL. PASS once #352 is merged.
@paul-v-snet @vsbogd @sassless

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants