What this category's data looks like
In the grade entry and credit recognition scenario, common materials include transcripts, deferred examination applications, makeup examination arrangements, and signed receipts or approval pages. Transcripts carry course names, credits, grades, and entry dates; deferred examination applications carry the application reason, original examination date, and approval signature; makeup examination arrangements carry the makeup examination time, location, invigilation, and grade backfill requirements. Materials are mostly updated by semester or batch, and inconsistencies often appear between versions in the name, quantity, or date of the same record, or signatures and receipts are missing. When materials enter this feature, each serves as a candidate basis source; hybrid retrieval merges the vector and full-text result sets, then the reranking model sorts and filters them, and finally citation trimming and answer generation produce basis entries that can be traced back to the original text.
Configuration and implementation checks
This step is executed by the reranking model in the retrieval service, which outputs the sorted candidates and reranking scores. "Basis entries that can be traced back to the original text" are then completed by citation trimming and answer generation. Hybrid retrieval simultaneously runs the vector and full-text paths and merges the results; after merging, the scope is large and similarity filtering cannot be applied directly, so the reranking model is usually then used to sort and filter by reranking score.
| Object | Check | Verification action |
|---|---|---|
| Transcript | Fields include course name, credits, grade, entry date, and signature; must be aligned item by item with the deferred examination application and makeup examination arrangement | Check searchMode and usingReRank in the search parameters, and compare the number of candidate entries and scores before and after reranking |
| Deferred examination application | Reason, original examination date, approval signature, and receipt must be complete, and consistent with the dates in the transcript and makeup examination arrangement | Check whether candidates come from both paths at the same time, and verify the impact of similarity and limit on the top few entries |
| Makeup examination arrangement | Makeup examination time, location, invigilation, and grade backfill requirements must correspond to the transcript and deferred examination application | Compare the ordering and scores before and after reranking, and confirm that the top few entries can be traced back to the original text of specific materials |
| Reranking model | Already bound and used for sorting and filtering, outputting the sorted candidates and reranking scores | Compare the ordering and scores before and after reranking, and record changes in the number of candidate entries and scores |
Three common errors
- Symptom: The course name, credits, or date of the same record do not match between the transcript and the makeup examination arrangement. Cause: The two materials were entered separately without version synchronization, and there is no unified field verification.
- Symptom: The deferred examination application lacks an approval signature or receipt, and the basis entry cannot be traced back to the original text. Cause: Signatures and receipts were not fully collected during material circulation, and fields are incomplete when entering retrieval.
- Symptom: There are many candidates but the top few are irrelevant, or the results are clearly biased toward keyword hits. Cause: After hybrid retrieval merging, the scope is large, reranking score filtering is not used, and the weights of vector and full-text are imbalanced.
How to verify the setup
Acceptance of this feature: compare the order and scores of the top three entries before and after enabling reranking, verify changes in the number of candidate entries and reranking scores, and check whether usingReRank and similarity take effect as expected.
Business test: ask a basis question that spans materials, see whether the answer provides traceable sources, and confirm that the basis comes from the institution’s materials, the version is current, and the entries match the original text.
- Check
searchMode,usingReRank,similarity, andlimitin the search parameters, compare the ordering and scores before and after reranking, and record the number of candidate entries. - Verify the fields, dates, and signatures of the transcript, deferred examination application, and makeup examination arrangement one by one, and confirm that the name, quantity, and date of the same record are consistent and the versions are synchronized.