Reranking and Hybrid Retrieval for School Teacher Training Credits: Find Supporting Evidence

Teacher Credits: review reranking for evidence lookup. Compare the source records, required inputs and downstream results before handing the task over.

What this category's data looks like

This page addresses the scenario of credit management for primary and secondary school teacher training. The materials come from three categories: training notices, credit recognition forms, and participant lists. They are usually updated by training batch or semester, and the fields include teacher name, ID number, training project name, class hours, credits, recognition date, and signature field. The training notice provides the project and class-hour definitions; the credit recognition form carries the recognition results and signatures; the participant list provides the correspondence between personnel and attendance. When the three categories of materials enter the retrieval service, they each participate in hybrid retrieval as candidate source bases, and after merging and reranking they form citable candidate entries, for checking the original text item by item when answering parents or writing into a plan.

Configuration and implementation checks

This step is executed by the reranking model in the retrieval service, which outputs the sorted candidates and rerank scores. The citable basis entries that can point back to the original text are then completed by citation trimming and answer generation. Reranking does not rewrite the original text, nor does it generate a finished business product.

ObjectCheckVerification action
Training noticeWhether the project name, class-hour definitions, effective date, and issuing signature are consistent with the current versionCheck the original notice against the current version, confirm that the project name, class hours, date, and signature are complete, then compare against the source of the candidate entries
Credit recognition formWhether the teacher name, credit quantity, recognition date, and signature field correspond to the participant listOpen the original recognition form, compare the name, quantity, date, and signature item by item, and record the original text location pointed to by the candidate entries
Participant listWhether the personnel names, attendance records, and training batch dates are consistent with the notice and recognition formCompare the original list with the notice and recognition form, confirm that the name, quantity, and date of the same record match, then check the rerank score and the number of candidates
Retrieval serviceCandidates come from the merge of two paths; the order and scores before and after reranking can be comparedCheck searchMode and usingReRank in the search parameters, and use similarity and limit to observe changes in the number of candidates and scores

Three common errors

  • Symptom: the same teacher name is written differently in the recognition form and the participant list. Cause: the two materials were not unified when entered, and after reranking the original text names pointed to by the candidate entries do not match.
  • Symptom: the class-hour definitions in the training notice are inconsistent with the quantity in the recognition form. Cause: the notice version was not synchronized, the old version still participates in retrieval, and the candidate entries cite an expired basis.
  • Symptom: the recognition form lacks a signature or receipt. Cause: the material archiving is incomplete; although the candidate entries can point back to the original text, the basis entries do not satisfy the current validity conditions.

How to verify the setup

This feature's acceptance: compare the order and rerank scores of the first three items before and after enabling reranking, check changes in the number of candidates, and confirm the actual values of usingReRank, similarity, and limit in the search parameters.

Business test: ask a basis question that spans materials, see whether the answer provides a citable source, and check the name, quantity, date, and signature in the original text item by item.

  • Check the two-path switches of hybrid retrieval and searchMode in the search parameters, and confirm that candidates come from both the vector and full-text paths.
  • Compare the order and scores before and after reranking, record the number of candidates and the rerank scores, and check whether the first few items are relevant and point back to the original text.