What this category's data looks like
Materials for this category are mainly study-abroad service contracts, school application forms, and personal statements, plus transcripts, recommendation letters, proof of funds, and visa receipts. Sources are paper or electronic documents produced during signing and application, with updates rolling with application rounds, supplementary documents, and visa progress. Field characteristics center on four types: name, quantity, date, and signature: service items and amounts in contracts, courses and start/end times in application forms, experiences and timelines in personal statements. It is common for the same record to have mismatched names, quantities, or dates across two materials, and there are also cases of unsynchronized versions, missing signatures, or missing receipts. When entering this function, contracts and application forms serve as the source of basis items, personal statements serve as narrative corroboration, and transcripts and receipts serve as factual verification; each material is split by field and then enters the retrieval and reranking process.
Configuration and implementation checks
This step is executed by the rerank model in the retrieval service, outputting ranked candidates and rerank scores. "Basis items that can be traced back to the original text" are then completed by citation trimming and answer generation. Hybrid retrieval runs both vector and full-text paths simultaneously and merges the results; after merging, the scope is large and similarity filtering cannot be applied directly, so the rerank model is usually used again to sort and filter by rerank score.
| Object | Check | Verification action |
|---|---|---|
| Study-abroad service contract | Service item names, amounts and quantities, signing date, and signatures of both parties must be consistent with the application plan | Check the contract fields against the corresponding records in the application form and personal statement, compare names, quantities, dates, and signatures, and confirm the version is current |
| School application form | Course names, start/end dates, application round, and signature receipt must match the contract and personal statement | Check the correspondence between application form fields and the contract and personal statement, confirm dates and quantities are consistent and receipts are complete |
| Personal statement | Experience names, timeline, and quantity descriptions must be consistent with the contract and application form | Compare the fields of the personal statement with the contract and application form, confirm there are no conflicts in names, dates, or quantities, and that the version is current |
| Rerank model | Bound and used for sorting and filtering; candidate count and rerank score can be compared | In the search parameters, check searchMode and usingReRank, compare candidate count and scores before and after reranking, and record the status of similarity and limit |
Three common errors
- Symptom: the same record has mismatched names, quantities, or dates in the contract and application form. Cause: materials are filled in by different stages, field definitions are not unified, and cross-material comparison is not done before retrieval.
- Symptom: the personal statement and contract versions are not synchronized, and citations refer to old wording. Cause: after materials are updated, they are not written back or replaced, retrieval still hits historical versions, and version markers are missing.
- Symptom: the application form or receipt lacks a signature, and the basis item cannot be traced back. Cause: the receiving and archiving stages do not verify signatures and receipts, and materials enter retrieval in an incomplete state.
How to verify the setup
This function's acceptance: turn reranking on and off to compare the order and scores of the top three, check changes in candidate count and rerank score, confirm usingReRank is enabled and searchMode is hybrid retrieval, and record the values of similarity and limit.
Business test: ask a cross-material basis question, see whether the answer gives traceable sources, and check whether the contract, application form, or personal statement fields, dates, and signatures pointed to by the sources are consistent.
- In the search parameters, check the two-path switches of
searchModeand the binding status ofusingReRank, compare the order and scores of the top three before and after reranking, and record the candidate count and rerank score. - Compare names, quantities, dates, and signatures item by item for the contract, application form, and personal statement, mark items with unsynchronized versions or missing receipts, and confirm the basis comes from the current materials and the version is current.