What this category's data looks like
The development of talent cultivation programs in vocational colleges involves three types of materials: talent cultivation programs, curriculum standards, and job competency analysis tables. The talent cultivation program defines the professional positioning and curriculum system, the curriculum standard defines the course objectives and content, and the job competency analysis table defines job tasks and competency requirements. The material sources are academic affairs, secondary schools/departments, and industry research, updated by academic year or professional demonstration cycle. Field characteristics include program name, course name, credit hours, job title, competency items, formulation date, review date, signature, and version number. When entering the knowledge base for retrieval, the three types of materials serve as candidate fragment sources. The retrieval node and search test are responsible for recall and ranking, and subsequent nodes or manual work draft signable drafts and handover records accordingly.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate fragments and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The signable material drafts and handover records are then completed by subsequent nodes or manual work.
| Object | Check | Verification action |
|---|---|---|
| Talent cultivation program | Whether the program name, course name, credit hours, formulation date, and signature are consistent with the curriculum standard | In the search test, switch searchMode, check the names, quantities, and dates in the candidate fragments; record the number of candidates and scores |
| Curriculum standard | Whether the course name, credit hours, version number, and review date correspond to the talent cultivation program | Enable or disable usingReRank, compare the ranking of the top few results; check whether key paragraphs are retained after similarity filtering |
| Job competency analysis table | Whether the job title, competency items, research date, and signature receipt connect with the talent cultivation program | Retrieve once each with synonymous questions, check whether the candidates include both semantic and full-text results; record the number of citations after limit trimming |
| Handover record | Whether the responsible person, handover date, version number, and receipt status are complete | Draft one according to the template and complete one handover, see whether missing items are blocked; check the tokens of the cited text and record the array count separately |
Three common errors
- Phenomenon: The credit hours or dates of the same course do not match in two materials. Cause: The draft was not based on the same version, and the retrieval candidates did not cover the corresponding fragments.
- Phenomenon: The talent cultivation program has been updated, but the curriculum standard is still the old version. Cause: The version was not synchronized, the retrieval did not hit the latest candidate, and the handover did not check the version number.
- Phenomenon: The handover record lacks a signature or receipt. Cause: The responsible person was not specified, the template fields were not validated, and the retrieval citations did not include receipt information.
How to verify the setup
Acceptance of this feature: Test once each with synonymously rewritten questions, compare candidates and scores, then toggle rerank to see the ranking of the top few results; switch searchMode, and check the impact of similarity and usingReRank on candidates.
Business test: Draft one according to the template and complete one handover, see whether missing items are blocked.
- In the knowledge base search test, switch
searchMode, and compare the number of candidates and scores for semantic, full-text, and hybrid modes. - Enable or disable
usingReRank, compare the ranking of the top few results; check the tokens of the cited text aftersimilarityfiltering andlimittrimming, and record the array count separately.