What this category's data looks like
Materials for this category fall into three types: study abroad service contracts, school application forms, and personal statements. Contracts record the scope of services, fees, and the signature dates of both parties; application forms record the institution, program, intake term, and submission receipt; personal statements record the version, word count, and finalization date. The three types of materials update at different rhythms: contracts change versions with supplementary agreements, application forms adjust with institution requirements, and personal statements iterate by round. When materials enter knowledge base retrieval and recall, contracts and application forms serve as the source of basis, while personal statements serve as supporting evidence; the name, quantity, and date of the same record must align across the two types of materials, and versions missing signatures or receipts must not be used as the current basis.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after pattern, merge, rerank, filter, and top-limit trimming). Basis entries that can point back to the original text are then completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Study abroad service contract | Fields include service scope, fees, and signature date; the version must be current, with complete signatures and receipts | In the search test, use the contract name and date as the query to retrieve, check whether the candidate chunks hit the current version, and record the number of candidate entries and scores |
| School application form | Fields include institution, program, intake term, and submission date; the institution name and quantity must be consistent with those in the contract | Switch searchMode to semantic, full-text, and hybrid and test each once, and see whether the candidates cover both the application form and contract fields |
| Personal statement | Fields include version number, word count, and finalization date; it must align with the program direction in the application form | Compare the ranking of the top few entries before and after enabling usingReRank, and confirm that the finalized version ranks before the draft |
| Basis entry | The entry must point back to the original text, and the name, quantity, and date must match across materials | After filtering by similarity, record the number of candidate entries, and check and record the cited text tokens and the number of array entries separately |
Three common errors
- Symptom: the same institution name is written differently in the contract and the application form, and retrieval hits only one. Cause: the name is not unified, and the candidate is trimmed by similarity filtering.
- Symptom: the personal statement finalization date does not match the application form submission date, and the answer cites an old version. Cause: the version is not synchronized, and the current version does not enter the candidates.
- Symptom: the contract is missing a signature or receipt but is still recalled as a basis. Cause: the material fields are incomplete, and retrieval does not filter by signature status.
How to verify the setup
Acceptance for this feature: test once each with synonym-rewritten queries, compare candidates and scores, then toggle rerank on and off to inspect the ranking of the top few entries.
Business test: ask a cross-material basis question and see whether the answer provides a traceable source.
- In the search test, fix the query, switch
searchModeamong the three options, and record the number of candidate entries and scores. - Enable and disable
usingReRank, compare the order of the top few entries, and after filtering bysimilarity, check the cited text tokens.