What this category's data looks like
This page focuses on the external service materials for the exam organization and violation handling category, including three types: exam administration manuals, examination room record sheets, and violation fact records. The exam administration manual defines procedures and authorization levels, the examination room record sheet carries the on-site time, examination room number, and invigilator signature, and the violation fact record documents candidate information, behavior descriptions, and handling opinions. The three types of materials come from archiving by the exam administration department and per-session backfilling, with updates synchronized by exam batch, and versions identified by batch number and issuance date. When the materials enter the knowledge base retrieval and recall function, the exam administration manual serves as the rule basis to provide the authorization scope and external messaging, the examination room record sheet serves as process evidence to provide time and signature fields, and the violation fact record serves as the fact source to provide name, quantity, and date fields. The three types of materials each play different roles, and during retrieval they are aligned by field and date to avoid the same record having mismatched names, quantities, and dates across two materials.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate snippets and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The externally accessible entry points and authorization scope are then completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Exam administration manual | The authorization scope and external messaging must be consistent with the issuance date and version number; missing signatures or receipts cannot be used as an external basis | In the search test, switch searchMode and check whether the candidate snippets cover the authorization levels and external clauses |
| Examination room record sheet | The time, examination room number, and invigilator signature must be aligned item by item with the violation fact record; the same record's name and quantity must not be mutually exclusive | Test once each with synonym-rewritten questions, record the number of candidate entries and scores, and check the date and signature fields |
| Violation fact record | Candidate information, behavior description, and handling opinion must correspond to the clauses of the exam administration manual; when versions are not synchronized, the latest batch prevails | Compare the ranking of the top few entries before and after enabling usingReRank, and check the completeness of candidate content after similarity filtering |
| External entry points and authorization scope | The visitor's identity matches the visible scope; unauthorized content is not visible; restricted identities see only materials within the authorized level | Access once with a restricted identity, see whether the visible scope matches the settings, and record the number of cited entries after limit trimming |
Three common errors
- Phenomenon: The same violation record has mismatched name, quantity, and date between the examination room record sheet and the violation fact record. Cause: The two materials are backfilled by different steps and are not aligned item by item by batch number and signature.
- Phenomenon: The exam administration manual version is not synchronized, and the old authorization level is still retrieved and recalled. Cause: The material update rhythm is not synchronized with the exam batch, and the issuance date and version number are not filtered along with retrieval.
- Phenomenon: The examination room record sheet lacks an invigilator signature or receipt, but retrieval still returns candidate snippets. Cause: The signature field is not included in material admission checks, and retrieval recalls only by text similarity.
How to verify the setup
Acceptance for this feature: Test once each with synonym-rewritten questions, compare candidates and scores, then toggle rerank on and off to see the ranking of the top few entries; switch searchMode to compare semantic, full-text, and hybrid results, and check the number of candidate entries and scores after similarity filtering.
Business test: Access once with a restricted identity, see whether the visible scope matches the settings, unauthorized content is not visible, and record the number of cited entries and cited text tokens after limit trimming.
- In the knowledge base search test, switch
searchModeto compare the candidate results of semantic, full-text, and hybrid options, and check whether multi-path merging includes both semantic and full-text results. - Compare the order of the top few entries before and after enabling
usingReRank, check the tokens of the cited text aftersimilarityfiltering andlimittrimming, and record the array entry count separately.