What this category's data looks like
Materials for off-campus training compliance filing and penalty response enter knowledge base retrieval and recall in three categories: school operating licenses, course filing materials, and fee disclosure. A school operating license contains the institution name, address, validity period, issuance date, and seal; course filing materials contain the course name, class hours, target students, filing date, and handler signature; fee disclosure contains fee items, amounts, disclosure date, and receipt. The three categories play different roles in retrieval: licenses and filing materials are used to answer questions about qualifications and course scope, while fee disclosure is used to answer questions about refunds and the basis for fees. The material update cadence is affected by filing changes, penalty decisions, and disclosure adjustments, and it is common for the name, quantity, and date of the same record to mismatch across two materials, for versions to be out of sync, and for signatures or receipts to be missing. During retrieval, semantic, full-text, or hybrid mode is selected according to the material form, and candidate chunks and similarity scores are passed to subsequent nodes or handled manually to generate a handover-ready deployment status and operation record.
Configuration and implementation checks
This step is performed by the knowledge base retrieval service (retrieval node and search test), which outputs candidate chunks and similarity scores (after mode, merge, rerank, filter, and limit trimming). The handover-ready deployment status and operation record are then completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| School operating license | Institution name, address, validity period, issuance date, and seal must be consistent with the course filing materials | In the search test, test once each with synonymous questions, check whether the license fields in the candidate chunks match the filing material fields, and record the number of candidates and scores |
| Course filing materials | Course name, class hours, target students, filing date, and handler signature must be consistent with the fee disclosure | Switch searchMode to semantic, full-text, and hybrid, compare whether the candidates contain both categories of materials at the same time, and check whether signatures and receipts are complete |
| Fee disclosure | Fee items, amounts, disclosure date, and receipt must be in version sync with the filing materials | Adjust similarity and limit, see whether the trimmed reference text retains the key disclosure chunks, and record the array count separately |
| Retrieval node and search test | Candidate chunks and similarity scores are consistent after mode, merge, rerank, filter, and limit trimming | Turn usingReRank on and off, compare the ranking changes in the top few results, and check whether the number of candidates and scores are stable |
Three common errors
- Symptom: the name and class hours of the same course mismatch between the filing materials and the fee disclosure. Cause: the two materials are entered separately, versions are out of sync, and signatures or receipts are missing.
- Symptom: the license validity period and the filing date are inconsistent across the two materials. Cause: the update cadences differ, the old version was not replaced, and the handover form was not checked item by item.
- Symptom: there are many candidates but the top-ranked ones are all irrelevant, and the answer lacks key passages. Cause: the retrieval mode does not match the material form, rerank is not enabled, or the similarity filter is too loose.
How to verify the setup
Feature acceptance: test once each with synonymously rewritten questions, compare candidate chunks and similarity scores, then turn rerank on and off to observe ranking changes in the top few results, and check the values of searchMode, similarity, and limit.
Business test: check item by item according to the handover form, see which item's record is missing, and confirm that version, connection, and task record are consistent.
- In the search test, retrieve the school operating license, course filing materials, and fee disclosure separately using synonymous questions, record the number of candidates and scores, and check fields, dates, and signatures.
- Check the deployment status and operation record item by item according to the handover form, and after confirming that version, connection, and task record are consistent, hand over to operations or the next shift.