What this category's data looks like
The data for this category looks like this: Academic education management in technical colleges involves student registration forms, teaching plans, skills training records, and other materials. The sources are academic affairs, student affairs, and practical training departments, and the update rhythm follows semester registration, plan adjustments, and training batch progress. When materials enter knowledge base retrieval, student registration forms provide student identity and registration status fields, teaching plans provide courses, class hours, and assessment dates, and skills training records provide training items, quantities, and signed receipts. Together, the three support candidate recall for version ledgers and change records. The retrieval service returns fragments and scores according to material form, for subsequent nodes or manual comparison of the consistency of fields, dates, and signatures.
Configuration and implementation checks
How to configure it: The knowledge base retrieval service (retrieval node and search test) only outputs candidate fragments and similarity scores (after pattern, merge, rerank, filter, and limit trimming). Version ledgers and change records must be handled by subsequent nodes or manually. Retrieval consists of question optimization, semantic/full-text/hybrid recall, multi-path merging, rerank secondary sorting, similarity filtering, and citation limit trimming, ultimately producing the citation content handed to the model.
| Object | Check | Verification action |
|---|---|---|
| Student registration form | Check whether field names, registration dates, and signatures are consistent with the teaching plan | In the search test, use the same question with different wording to retrieve, record the number of candidates and scores, and switch searchMode to compare semantic and full-text results |
| Teaching plan | Check whether course names, class hour quantities, and assessment dates match the skills training records | Turn usingReRank on or off, compare the ranking of the top few results, and check the impact of similarity and limit on candidates |
| Skills training record | Check whether training items, quantities, dates, and signed receipts are complete | Check the tokens and array count of the returned citation text to confirm that key passages have not been trimmed or lost |
| Version ledger and change records | Check that the current version is unique, old versions are traceable, and citations are synchronized | After changing one piece of content, retrieve again to see whether the version number and citations are updated synchronously |
Three common errors
- Phenomenon: The name, quantity, and date of the same record do not match across two materials. Cause: Material sources are not synchronized, versions are not synchronized, and retrieval candidates are not filtered by the current version.
- Phenomenon: Old versions are still recalled, and citations point to outdated content. Cause: The version ledger is not updated, change records lack signatures or receipts, and retrieval is not associated with the current version.
- Phenomenon: The same question with different wording cannot be recalled, and although there are many candidates, the ones ranked at the top are all irrelevant. Cause: The retrieval mode does not match the material form, rerank is not enabled, or similarity filtering is too loose.
How to verify the setup
Acceptance for this feature: Test once each with synonym-rewritten questions, compare candidates and scores, then turn rerank on and off to see the ranking of the top few results; record the number of candidates and scores, and check the impact of similarity, limit, searchMode, and usingReRank on the results.
Business test: Change one piece of content and see whether the version number and citations are updated synchronously.
- In the knowledge base search test, switch retrieval modes and compare whether semantic and full-text recall candidates appear at the same time.
- After changing one piece of content, retrieve again, check whether the version number and citations are updated synchronously, and check whether signatures or receipts are complete.