What this category's data looks like
This page is intended for enterprise compliance and security training scenarios. The materials mainly fall into three categories: compliance training courseware, security operating procedures, and exam records. Courseware and procedures are usually updated according to the policy revision cycle, and their fields include courseware number, applicable position, effective date, version number, and author; operating procedures additionally include step number, risk point, protective measure, and approval signature; exam records include personnel identifier, exam paper number, score, exam date, and invigilator signature. When the three types of materials enter the knowledge base retrieval and recall function, their roles differ: courseware and procedures serve as the source of recalled snippets, supporting candidate and cited content generation; exam records serve as associated verification materials, used to compare whether the name, quantity, and date of the same record are consistent across two materials. In terms of update cadence, courseware and procedures are synchronized with policy versions, while exam records are archived by batch; during handover, it is necessary to check whether the version, connection, and task records are consistent, and items missing signatures or receipts are listed separately.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate snippets and similarity scores (after mode, merge, rerank, filter, and limit trimming). The handover-ready deployment status and operation records are completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Compliance training courseware | Whether the courseware number, applicable position, effective date, version number, and author are complete, and whether the courseware name and date can be matched with those in the exam records | In the knowledge base search test, switch searchMode to semantic, full-text, or hybrid, compare candidate snippets and similarity scores, and record the number of candidates |
| Security operating procedures | Whether the step number, risk point, protective measure, and approval signature are complete, and whether the version is synchronized with the currently effective version | Test once each with usingReRank enabled and disabled, compare the order of the first few items, and check the tokens and array length of the returned cited text |
| Exam records | Whether the personnel identifier, exam paper number, score, exam date, and invigilator signature are complete, and whether the name, quantity, and date are consistent with those in the courseware and procedures | Check item by item once according to the handover list to see which record is missing; separately record the number of candidates and the score, and record the number of citations according to the array length |
Three common errors
- Symptom: The name, quantity, and date of the same exam record do not match between the courseware list and the exam ledger. Cause: The two materials are maintained separately and are not aligned to the same version number and effective date.
- Symptom: The operating procedure version is not synchronized, and retrieval still recalls the old version of the steps. Cause: Knowledge base updates are disconnected from policy release, and the version and task records are not checked during handover.
- Symptom: Exam records are missing signatures or receipts, and the handover list cannot be closed. Cause: Items are omitted in the archiving step, and verification only looked at the number of candidates without checking fields item by item.
How to verify the setup
Acceptance of this function: Test once each with synonym-rewritten questions, compare candidate snippets and similarity scores, then enable and disable rerank to observe the ordering of the first few items; after switching searchMode and adjusting limit, record the number of candidates and the score, and record the number of citations separately according to the array length.
Business test: Check item by item once according to the handover list to see which record is missing; check whether the version, connection, and task records are consistent, and list items missing signatures or receipts separately.
- In the knowledge base search test, switch
searchModeto semantic, full-text, or hybrid, compare candidate snippets andsimilarityscores, and record the number of candidates and the score. - Test once each with
usingReRankenabled and disabled, compare the order of the first few items; check the tokens of the returned cited text, and record the number of citations separately according to the array length without performing equality comparison.