What this category's data looks like
In exam organization and violation handling scenarios, materials come from three types: exam administration manuals, examination room record sheets, and violation fact records. Exam administration manuals are updated per exam session and contain process clauses, field definitions, and signature requirements; examination room record sheets are generated per session and contain examination room number, expected and actual attendance counts, time, and invigilator signatures; violation fact records are generated per incident and contain candidate information, behavior description, date, and review signature. When these three types of materials enter the knowledge base retrieval service, each serves as an independent candidate source: the manual provides field definitions and version basis, the record sheet provides quantity and time facts, and the violation record provides names and signature status. The materials update at different paces: the manual may be reused across exam sessions, while record sheets and violation records are generated immediately with sessions and incidents. When versions are not synchronized, the name, quantity, and date of the same object in two materials are likely to mismatch.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate snippets and similarity scores (after mode, merge, rerank, filter, and limit trimming). The discrepancy list is completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Exam administration manual | Whether fields, dates, and signature definitions are consistent with the record sheet | Use the same record number to switch searchMode in the search test, compare candidate snippets from the manual and the record sheet, and check whether field names, dates, and signature requirements match |
| Examination room record sheet | Whether the name, quantity, and date of the same record are consistent with the ledger | Retrieve using the record number as the query, check the number of candidates and scores, and verify whether expected and actual attendance counts, examination room date, and invigilator signature are consistent with ledger fields |
| Violation fact record | Whether the name, date, and review signature are consistent with the manual and ledger | Compare the order of the top few candidates before and after enabling usingReRank, and check whether the violation behavior name, occurrence date, and review signature are complete |
| Candidate snippets and scores | Whether key fields are retained after similarity filtering and citation limit trimming | Adjust similarity and limit, record the number of candidates and scores, and check whether name, quantity, and date fields in the cited text can still be located |
Three common errors
- Phenomenon: The name, quantity, and date of the same record in the examination room record sheet and the violation fact record do not match. Cause: The two types of materials are generated by different sessions and incidents, field definitions are not unified, and retrieval candidates each match different expressions.
- Phenomenon: The exam administration manual version is not synchronized, and the date and signature requirements of the same object in the two materials are inconsistent. Cause: The manual is reused across exam sessions, record sheets are generated immediately with sessions, and retrieval does not filter by version.
- Phenomenon: Violation fact records lack review signatures or receipts, yet candidate snippets are still recalled. Cause: Retrieval only outputs candidates and scores; signature status is a material field fact and must be manually annotated in the discrepancy list.
How to verify the setup
Acceptance of this feature: test once each with synonym-rewritten queries, compare candidates and scores, then toggle rerank to observe the ordering of the top few results.
Business test: use one real record to find fields inconsistent with the ledger.
- In the search test, use the same record number to retrieve with three query types—name, quantity, and date—record the number of candidates and scores, and annotate fields inconsistent with the ledger.
- Switch
searchModeand toggleusingReRank, compare candidate order, and check whether the cited text aftersimilarityandlimittrimming retains name, quantity, date, and signature fields.