What this category's data looks like
Self-funded study abroad application services involve study abroad service contracts, school application forms, personal statements, and other materials. The contract contains service items, fees, and a signature field; the application form contains fields such as institution, major, and intake term; the personal statement contains the student's name, application direction, and date. Materials are submitted by advisors during the intake stage and updated in batches as the application progresses. Field characteristics include: the same record's name, quantity, and date may be inconsistent across different materials; when versions are not synchronized, the old version is still retrieved; when signatures or receipts are missing, the materials are incomplete. When entering the knowledge base retrieval function, the contract is used to verify the service scope and signing status, the application form is used to confirm institution and major information, and the personal statement is used to extract the application direction and timeline. The retrieval service accordingly recalls candidate chunks and gives similarity scores, while the intake record and the completed follow-up questions are handled by subsequent nodes or manually.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after mode, merge, rerank, filter, and limit truncation). "The intake record and the completed follow-up questions" are then handled by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Study abroad service contract | Whether fields, dates, and signature are complete; whether service items and fees are consistent with the application form | In the search test, switch searchMode, search with contract keywords, and check whether the candidate chunks contain the signature field and date; record the number of candidates and the score |
| School application form | Whether the institution, major, and intake term fields are consistent with the contract and personal statement; whether the dates match | Compare the top few rankings before and after enabling usingReRank, and check whether the application form fields are recalled; use similarity to filter low-scoring candidates, and separately record the length of the citation array |
| Personal statement | Whether the student's name, application direction, and date are consistent with the contract and application form; whether the version is synchronized | Test once each with synonym-rewritten questions, and compare candidates and scores; check the tokens of the cited text after limit truncation, and confirm that key passages have not been cut off |
| Intake record and completed follow-up questions | Whether missing items are identified and followed up; whether the answer has material basis | Ask a question missing key information, and see whether it first follows up before answering; check whether the candidate chunks cover the three types of materials: contract, application form, and personal statement |
Three common errors
- Phenomenon: The same record's name and quantity do not match between the contract and the application form. Cause: The two materials were entered by different advisors without field-level verification, so different chunks are recalled for each during retrieval.
- Phenomenon: The personal statement version is not synchronized, and the old version is still retrieved. Cause: After updating, it was not re-imported or the index does not cover the new version, so the candidate chunks still point to the old content.
- Phenomenon: The contract lacks a signature or receipt, but the intake record still shows it as complete. Cause: The signature field was not recognized as a key field, the missing-item follow-up was not triggered, and the answer lacks material basis.
How to verify the setup
Feature acceptance: Test once each with synonym-rewritten questions, compare candidates and scores, then toggle rerank on and off to see the top few rankings; switch searchMode to compare the differences among semantic, full-text, and hybrid recall, and record the number of candidates and the score.
Business test: Ask a question missing key information, and see whether it first follows up before answering; check whether the follow-up items correspond to the missing fields in the contract, application form, and personal statement, and whether the answer has material basis.
- In the knowledge base search test, search separately with keywords from the contract, application form, and personal statement, record the number of candidates and the score, and check whether the tokens of the cited text after
similarityfiltering are complete. - Compare the top few rankings before and after enabling
usingReRank, and confirm that secondary ranking has been performed after hybrid retrieval; after truncation withlimit, separately record the length of the citation array, and do not compare it as equal to the citation content budget.