What this category's data looks like
In the scenario of district and county teaching research activities and classroom observation and evaluation, materials usually include three types: teaching research activity notices, classroom observation records, and evaluation meeting minutes. They are submitted by kindergartens and teaching research groups, and the update cadence advances by activity batch and semester milestone. Notice fields include activity name, date, location, participants, and signed receipt; classroom observation records include class, activity name, instructor, observation points, and signature; evaluation meeting minutes include evaluation time, participants, evaluation points, and signature. When these three types of materials enter this feature, notices provide the activity framework and version clues, classroom observation records provide on-site process and quantity information, and evaluation meeting minutes provide conclusions and improvement basis. All participate in retrieval as candidate basis entries, to be cited back to the original text when replying to parents or writing them into a plan.
Configuration and implementation checks
This step is executed by the rerank model in the retrieval service, outputting ranked candidates and rerank scores. The basis entries that can be cited back to the original text are then completed by citation trimming and answer generation. Hybrid retrieval simultaneously goes through the vector and full-text paths and merges the results. After merging, the scope is large and similarity filtering cannot be directly applied, so the rerank model is usually then used to sort and filter by rerank score.
| Object | Check | Verification action |
|---|---|---|
| Teaching research activity notice | Name, date, participants, and signed receipt need to correspond with the classroom observation record and evaluation meeting minutes, and the version must be current | Check the two-path switches of searchMode in the search parameters, and see whether candidates come from both the vector and full-text paths at the same time |
| Classroom observation record | Class, activity name, instructor, observation points, quantity, and date need to match the notice and evaluation meeting minutes, and signatures must be complete | Compare the order and scores before and after reranking, and use usingReRank to confirm that the rerank model is bound and used for sorting and filtering |
| Evaluation meeting minutes | Evaluation time, participants, evaluation points, and signature or receipt need to be consistent with the notice and classroom observation record, and the version must be synchronized | Check the number of candidate entries and the rerank score, use limit to control the number of returned entries, and confirm that the first few entries can be cited back to the original text |
| Hybrid retrieval and reranking | Both the vector and full-text paths are enabled and merged, and the rerank model is bound and used for sorting and filtering | Check the two-path switches in the search parameters, compare the order and scores before and after reranking, and observe whether similarity filtering takes effect |
Three common errors
- Symptom: the name, quantity, and date of the same record do not match between the notice and the classroom observation record. Cause: materials are submitted separately by batch, and cross-material field verification was not performed.
- Symptom: the version of the evaluation meeting minutes is not synchronized, and it still references the old activity name and date. Cause: the update cadence advances by semester milestone, and the old version was not marked invalid.
- Symptom: the classroom observation record lacks a signature or receipt, and the basis entry cannot be cited back to the original text. Cause: signatures were not fully collected during submission, and the correspondence between the entry and the original text is broken.
How to verify the setup
Feature acceptance: compare the order and scores of the first three entries before and after enabling reranking, check the number of candidate entries and the rerank score, and confirm that usingReRank is bound and used for sorting and filtering.
Business test: ask a basis question that spans materials, see whether the answer gives a citable source, and check that the number of citations is the array length. quoteMaxToken is the citation content budget, and the two are not compared for equality.
- Check the two-path switches of
searchModein the search parameters, confirm that both the vector and full-text paths are enabled and merged, and see whether candidates come from both paths at the same time. - Compare the order and scores before and after reranking, use
limitto control the number of returned entries, usesimilarityto observe similarity filtering, and confirm that the first few entries can be cited back to the original text.