What this category's data looks like
Materials in the exam organization and violation handling category are mainly exam administration manuals, examination room record sheets, and violation fact records, sourced from exam system exports and scanned paper materials, with an update cadence that advances with exam batches and review cycles. When these three types of materials enter the knowledge base retrieval service, they play different roles: the exam administration manual provides the process and judgment criteria, the examination room record sheet provides the time, examination room, candidate, and invigilator signature, and the violation fact record provides the fact description, evidence number, and reviewer signature. Field characteristics center on candidate name, admission ticket number, examination room number, exam date, violation clause, evidence count, signature, and receipt. If the name, count, or date of the same record does not match across two materials, if versions are not synchronized, or if a signature or receipt is missing, then exception tracing and manual review lose the anchor point for verification.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The exception list and review conclusions are completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Exam administration manual | Whether the clause number, effective date, and signature field are consistent with the current batch | Search with clause keywords, check the number, date, and version marker in the candidate chunks, and confirm that no old version is mixed in |
| Examination room record sheet | Whether the candidate name, admission ticket number, examination room number, exam date, and invigilator signature are complete | Search by admission ticket number or examination room number, compare the fields of the candidate chunks with the original record sheet item by item, and record missing signature items |
| Violation fact record | Whether the fact description, evidence count, violation clause, and reviewer signature mutually corroborate with the record sheet | Search by evidence number or candidate name, check the count and date, and confirm that the reviewer signature exists and is traceable |
| Retrieval node and search test | Whether the number of candidate items and similarity scores support exception tracing | Switch searchMode to compare semantic, full-text, and hybrid candidates, enable rerank and observe the order of the top few items, and record the number of candidate items under similarity and limit |
Three common errors
- Symptom: the name or admission ticket number of the same candidate does not match between the examination room record sheet and the violation fact record. Cause: the two materials were entered at different times without cross-checking, and retrieval hit only one of them.
- Symptom: the exam administration manual clause has been updated, but the record sheet still references the old clause number. Cause: versions are not synchronized, and the old version chunk in the knowledge base is still recalled and scores high.
- Symptom: the violation fact record lacks a reviewer signature or receipt, and the exception list cannot enter handling. Cause: the scanned material is incomplete, and retrieval can only return the unsigned chunk.
How to verify the setup
This feature acceptance: test once each with synonym-rewritten questions, compare candidates and similarity scores, then toggle rerank on and off to observe the ordering of the top few items; switch searchMode to observe the difference between semantic and full-text candidates, and record the number of candidate items and cited text tokens under limit.
Business test: create an exception record, see whether the source material can be traced, and check the name, count, date, and signature across the exam administration manual, examination room record sheet, and violation fact record.
- In the knowledge base search test, switch
searchMode, compare semantic, full-text, and hybrid candidates, and confirm that the exception record can be traced to the source material. - Observe the ordering of the top few items once before and once after enabling rerank, check
similarityandlimit, and separately record the number of items in the citation array and the cited text tokens.