What this category's data looks like
District and county teaching research activity and classroom observation and evaluation materials include three categories: teaching research activity notices, classroom observation records, and classroom evaluation minutes. The sources are teaching research offices, school academic affairs offices, and subject groups, and the update cadence advances by activity batch and semester milestones. Notices contain the activity name, time, location, participation scope, and receipt requirements; classroom observation records contain the instructor, class, topic, observation dimensions, and signature; classroom evaluation minutes contain evaluation points, improvement suggestions, host, and signature. When these three categories of materials enter the knowledge base retrieval and recall function, notices and minutes serve as the main source for semantic retrieval, while classroom observation records, because they contain tables and short sentences, often require full-text retrieval to supplement recall; the name, quantity, and date of the same activity must remain consistent across the three categories of materials, and missing signatures and receipts will directly affect the uniqueness of the current version and the traceability of old versions in the version ledger.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after pattern, merge, rerank, filter, and upper-limit trimming). The version ledger and change records are completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Teaching research activity notice | The activity name, date, participation scope, receipt requirements, and signature field must be complete, and consistent with the classroom observation records and classroom evaluation minutes | In the search test, retrieve the same activity with synonymous questions, check the number of candidates and the scores, and check whether the notice chunks can still be recalled after switching searchMode |
| Classroom observation record | The instructor, class, topic, observation dimensions, and signature date must correspond to the notice and minutes; when the quantity does not match, first check hits and associations | Retrieve the same topic separately in full-text and hybrid modes, record the number of candidates and the scores, and confirm whether the top few rankings are closer to the original classroom observation record text after usingReRank is enabled |
| Classroom evaluation minutes | The evaluation points, improvement suggestions, host, and signature must be in the same version as the notice and classroom observation record, with old versions traceable and citations synchronized | Retrieve the same activity name, check whether the dates and quantities of the minutes chunks are consistent with the notice and classroom observation records, and check the tokens and array counts of the cited text after similarity filtering, recording them separately |
| Version ledger and change records | The current version is unique, old versions are traceable, and citations are synchronized; after changing one piece of content, the version number and citations should be updated synchronously | After modifying one evaluation point, retrieve again, compare changes in the number of candidates and scores, and confirm that old versions are traceable and that cited content is updated synchronously with the version |
Three common errors
- Symptom: The name, quantity, and date of the same activity do not match across two materials. Cause: The notice and classroom observation record are maintained separately, without checking fields against the same version ledger.
- Symptom: After changing one evaluation point, the retrieved citation is still the old version. Cause: The version was not synchronized, and the change record was not written back to the knowledge base or external documents.
- Symptom: The classroom evaluation minutes lack a signature or receipt, and the ledger cannot determine the current version. Cause: The signature field and receipt status were not verified when the materials were archived, and old-version traceability is insufficient.
How to verify the setup
Acceptance of this function: test once each with synonymously rewritten questions, compare the number of candidates and scores, then toggle rerank on and off to observe the ranking of the top few; switch searchMode and usingReRank, record the number of candidates and scores, record the number of citations separately by array length, and check the cited text tokens separately.
Business test: change one piece of content and see whether the version number and citations are updated synchronously.
- In the knowledge base search test, retrieve the same activity with synonymous questions, record the number of candidates and scores, and switch
searchModeto compare the recall differences among semantic, full-text, and hybrid modes. - After modifying one evaluation point, retrieve again, check whether the version number and citations are updated synchronously, confirm that old versions are traceable, and record the cited text tokens and array counts separately.