Knowledge Base Retrieval for Vocational College Curriculum Planning: Maintain Document Versions and Changes

Vocational Curricula: review retrieval for version tracking. Check source versions, input mappings and the values received by downstream nodes.

What this category's data looks like

The formulation of talent cultivation programs in vocational colleges involves three types of materials: talent cultivation programs, curriculum standards, and job competency analysis tables. Fields include major name, course name, credit hours and credits, applicable grade, compilation date, reviewer signature, and receipt. The material sources are the academic affairs office, secondary schools/departments, and the professional construction committee, and the update rhythm rolls with major adjustments, curriculum reform, and annual revisions. When the three types of materials enter knowledge base retrieval, the talent cultivation program provides the overall framework and training objectives, the curriculum standard provides course content and assessment requirements, and the job competency analysis table provides competency items and corresponding positions. During retrieval, each serves as a source of candidate fragments, matched by material form for semantic, full-text, or hybrid recall. Version differences often manifest as the same record having inconsistent names, quantities, or dates across two materials, or versions not being synchronized, missing signatures and receipts.

Configuration and implementation checks

This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate fragments and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The version ledger and change records are completed by subsequent nodes or manually; the retrieval results themselves are not a statistical table or authorization result.

ObjectCheckVerification action
Talent cultivation programWhether the major name, credit hours and credits, compilation date, and review signature are consistent across the three types of materialsIn the search test, use synonymous questions to retrieve once each, record the number of candidates and similarity scores, and verify the major name, credit hours and credits, date, and signature fields in the returned fragments
Curriculum standardWhether the course name, credit hours, assessment method, and applicable grade match the cultivation programSwitch searchMode to semantic, full-text, and hybrid and test each once, compare whether the candidates include both semantic and full-text results, and verify the course fields and version number
Job competency analysis tableWhether the competency item names, quantities, corresponding positions, and receipt dates are consistent with the curriculum standardTurn usingReRank on and off to compare the ranking of the top few items, verify the competency item names, quantities, and dates, and confirm that the old version is traceable and references are synchronized
Version ledger and change recordsThe current version is unique, the old version is traceable, and references are synchronizedAdjust similarity and limit to observe changes in the number of candidates and scores, verify that the tokens of the referenced text are recorded separately, and the number of array items is recorded separately

Three common errors

  • Phenomenon: The same major name is written differently in two materials, and the number of credit hours does not match. Cause: The versions are not synchronized, and the old curriculum standard has not been updated with the revision of the cultivation program.
  • Phenomenon: The course name and applicable grade are inconsistent between the cultivation program and the curriculum standard. Cause: The compilation date and signature receipt are missing, and the change records have not been documented.
  • Phenomenon: The same question cannot be recalled when rephrased, and although there are many candidates, the ones ranked at the top are all irrelevant. Cause: The retrieval mode does not match the material form, rerank is not enabled, or the similarity filter is too strict.

How to verify the setup

Acceptance of this feature: Use synonymously rewritten questions to test once each, compare candidates and scores, then turn rerank on and off to observe the ranking of the top few items.

Business test: Change one piece of content and see whether the version number and references are updated synchronously.

  • In the knowledge base search test, switch searchMode and compare the number of candidates and similarity scores of the semantic, full-text, and hybrid modes.
  • Turn usingReRank on and off to compare the order of the top few items, adjust similarity and limit, then verify the tokens of the referenced text, and record the number of array items separately.