What this category's data looks like
In the enterprise compliance and safety training category, common materials include compliance training courseware, safety operating procedures, exam records, and question-answer pairs in auxiliary data. Courseware and procedures are released by version, and exam records are archived by session, with fields including name, quantity, date, and signed receipt. When materials enter knowledge base retrieval, courseware and procedures serve as the source of basis, exam records serve as supporting evidence, and auxiliary data serves as guidance. In terms of update cadence, procedures are reversioned with regulatory or process changes, courseware is revised in sync with procedures, and exam records are added by batch. In terms of field characteristics, the same record may have inconsistent name, quantity, or date across different materials, versions may be out of sync, and signatures or receipts may be missing. Business basis queries need answers that can point back to specific materials and versions, so the retrieval stage first provides candidate snippets and similarity scores, which are then organized by subsequent nodes or manually into basis entries that can point back to the original text.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate snippets and similarity scores (after mode, merge, rerank, filter, and limit trimming). Basis entries that can point back to the original text are then completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Compliance training courseware | Fields include name, quantity, date, and signed receipt, and the version is current | In the search test, test once each with synonymous questions, record the number of candidates and scores, and check whether the returned snippets point to the current version of the courseware |
| Safety operating procedures | Fields include name, quantity, date, and signed receipt, and the version is current | Switch searchMode to compare semantic, full-text, and hybrid candidates, and check whether procedure entries match the original paragraphs |
| Exam records | Fields include name, quantity, date, and signed receipt, and the dates are consistent with the courseware and procedures | Compare the ranking of the top few results before and after enabling usingReRank, and check whether the record name, quantity, and date are consistent with the courseware and procedures |
| Knowledge base retrieval service | Candidate snippets and similarity scores undergo mode, merge, rerank, filter, and limit trimming | Record the number of candidates and scores, adjust limit and similarity, and observe the tokens and array length of the cited text after trimming |
Three common errors
- Symptom: The same exam record has inconsistent name, quantity, and date between the courseware and procedures. Cause: Multiple materials each maintain their own fields without cross-material consistency checks, and retrieval results are cited directly after being hit.
- Symptom: The procedures have been reversioned, but the courseware is still the old version, and the answer cites old-version clauses. Cause: Versions are out of sync, the knowledge base has not been updated to the current version, and retrieval still recalls historical snippets.
- Symptom: Exam records lack signatures or receipts, and basis entries cannot point back. Cause: Signature and receipt fields were not completed at archiving time, so retrieval can only return candidate snippets and cannot form a complete basis.
How to verify the setup
Acceptance for this feature: test once each with synonymously rewritten questions, compare candidates and scores, then toggle rerank on and off to inspect the ranking of the top few results.
Business test: ask a cross-material basis question and see whether the answer provides a source that can be pointed back to.
- In the knowledge base search test, switch
searchModeand compare the number of candidates and scores returned by semantic, full-text, and hybrid modes. - Test once before and after enabling
usingReRank, record changes in the order of the top few results, and adjustsimilarityandlimitto check the cited text tokens and array length.