What this category's data looks like
Under the student disciplinary and appeal processing category, three types of materials—disciplinary fact materials, disciplinary decision documents, and appeal statements—each play a different role when they enter the knowledge base retrieval service: disciplinary fact materials provide the original record fields, disciplinary decision documents carry the basis and date of the decision, and appeal statements carry the appeal request and receipt information. The sources are archived materials submitted by various schools/departments and student affairs offices on campus, and the update cadence advances in sync with the nodes of the disciplinary process. It is common for the same record to have mismatched names, quantities, and dates across two materials, with versions not synchronized, and missing signatures or receipts. After the three types of materials are retrieved, the candidate snippets and similarity scores are used by subsequent nodes or by humans to generate a unified terminology table and a comparison draft, ensuring that the same term is consistent throughout the entire text and that translated names can refer back to the original text, and finally delivered for external release.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate snippets and similarity scores (after pattern, merge, rerank, filter, and limit truncation). The unified terminology table and comparison draft are then completed by subsequent nodes or by humans.
| Object | Check | Verification action |
|---|---|---|
| Disciplinary fact materials | Whether the fields, dates, and signatures are consistent with the disciplinary decision document | In the search test, switch searchMode to semantic, full-text, or hybrid, compare the number of candidates and scores, and check the names, quantities, dates, and signatures |
| Disciplinary decision document | Whether the version is synchronized and whether the receipt is missing | Turn usingReRank on or off to compare the ranking of the top few results, and check whether the names, quantities, and dates of the same record match across the two materials |
| Appeal statement | Whether the appeal request and receipt fields are complete | Adjust similarity to observe the candidate filtering effect, record the number of cited entries and the tokens of the cited text, and check the signature and receipt |
| Knowledge base retrieval service | Whether the candidate snippets and similarity scores cover the key fields of the three types of materials | Test once each with synonym-rewritten questions, compare the candidates and scores, then toggle rerank to see the ranking of the top few results, and record the array length separately for limit |
Three common errors
- Phenomenon: The names, quantities, and dates of the same record do not match between the disciplinary fact materials and the disciplinary decision document. Cause: Multilingual materials and terminology handling are not unified, and versions are not synchronized.
- Phenomenon: The appeal statement lacks a signature or receipt, and the version of the disciplinary decision document is not synchronized. Cause: Before the materials enter retrieval, field completeness was not verified according to the category's check dimensions.
- Phenomenon: The same question cannot be recalled when rephrased. Cause: Question optimization and the recall mode do not match the material form, and the candidates do not cover the key snippets.
How to verify the setup
Acceptance for this feature: Test once each with synonym-rewritten questions, compare the candidates and scores, then toggle rerank to see the ranking of the top few results, and record the number of candidates and scores.
Business testing: Sample three terms and check whether their usage is consistent throughout the entire text, confirm that translated names can refer back to the original text, and check before delivery for external release.
- In the knowledge base search test, switch
searchModeto semantic, full-text, or hybrid, compare the candidate results, and record the number and scores. - Turn
usingReRankon or off to compare the order of the top few results, adjustsimilarityto observe the filtering effect, and record the array length separately forlimit.