TPTBusiness 2d0584b4cd feat: Intelligent embedding chunking instead of truncation ...

Change: Instead of truncating texts, now using intelligent chunking:

1. Content ≤ 20,000 characters: Single embedding (complete)
2. Content > 20,000 characters: Split into 20k chunks
   - Each chunk gets its own embedding
   - All embeddings are averaged
   - No information loss!

Benefits:
- No more text truncation
- Full information preserved
- Stays under 8192 token limit (nomic-embed-text)
- Average embedding represents entire text

Affected files:
- rdagent/components/knowledge_management/vector_base.py

2026-04-02 19:22:50 +02:00

..

app

feat: Beautiful CLI dashboard + corrected start command

2026-04-02 19:21:08 +02:00

components

feat: Intelligent embedding chunking instead of truncation

2026-04-02 19:22:50 +02:00

core

feat: add a web UI server (#1345)

2026-03-18 14:04:52 +08:00

oai

feat: add LLM-finetune scenario (#1314)

2026-03-02 19:04:10 +08:00

scenarios

feat: EURUSD Trading-Verbesserungen implementiert (Phase 1)

2026-03-30 19:56:26 +02:00

utils

feat: add a web UI server (#1345)

2026-03-18 14:04:52 +08:00