Knowledge Base Retrieval for Vocational College Skills Competition Organization: Draft Materials and Hand Over Responsibilities

Skills Competitions: review retrieval for material handover. Check source versions, input mappings and the values received by downstream nodes.

What this category's data looks like

This category's data looks like this: Vocational college skills competition organization involves three types of materials: competition regulations, registration forms, and training plans. The sources are the academic affairs and competition affairs departments, and the update cadence rolls according to competition schedule milestones. Competition regulations contain the event name, group, time and location, scoring criteria, and signature/seal fields; registration forms contain contestant name, student ID, competition event, supervising instructor, and signature; training plans contain phase objectives, week numbers, venue, instruction records, and confirmation signature. When these three types of materials enter knowledge base retrieval and recall, each serves as a candidate chunk source: regulations provide rules and schedule chunks, registration forms provide personnel and event chunks, and training plans provide progress and signature chunks. The name, quantity, and date of the same record must be consistent across the three materials, versions and dates must be synchronized, and signatures and receipts must be complete, before a signable material draft and handover record can be formed.

Configuration and implementation checks

Configuration and implementation checks: This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after mode, merge, rerank, filter, and limit trimming). The signable material draft and handover record are completed by subsequent nodes or manually.

ObjectCheckVerification action
Competition regulationsFields complete: event name, group, time and location, scoring criteria, signature field; version and date consistentIn the search test, use synonymous questions to retrieve regulation chunks, view the number of candidates and scores, and check whether the signature field and date field are complete
Registration formFields complete: contestant name, student ID, competition event, supervising instructor, signature; matches the event name and date in the regulationsSwitch searchMode to compare semantic and full-text candidates, and check whether the same contestant's name and quantity are consistent across the two materials
Training planFields complete: phase objectives, week numbers, venue, instruction records, confirmation signature; when versions are not synchronized, use the latest dateEnable usingReRank to compare the ordering of the top few results, and check whether the training plan chunks cover the key paragraphs
Handover recordResponsible person clear, version and date consistent, signatures and receipts completeDraft according to the template and complete one handover, using similarity and limit to observe whether key original text chunks are retained after candidate trimming

Three common errors

  • Symptom: The same contestant's event name and quantity do not match between the registration form and the regulations. Cause: The two materials were imported separately and no same-record association check was performed, so candidate chunks were recalled separately.
  • Symptom: The training plan version is not synchronized, and the date and signature fields are missing. Cause: The update cadence did not roll with competition schedule milestones, and old-version chunks are still recalled and ranked at the front.
  • Symptom: There are many candidates but the ones ranked at the front are irrelevant, and the answer lacks key paragraphs. Cause: The retrieval mode does not match the material form, rerank is not enabled, or similarity filtering and citation limit trimming are inappropriate.

How to verify the setup

How to verify the setup: Acceptance for this feature: test once each with synonym-rewritten questions, compare candidates and scores, then toggle rerank on and off to observe the ordering of the top few results; record the number of candidates and scores, record the number of citations separately by array length, and check the tokens of the cited text separately.

Business test: Draft one according to the template and complete one handover, and see whether missing items are blocked.

  • In the knowledge base search test, switch searchMode to compare the number of candidates and scores across semantic, full-text, and hybrid modes, and confirm the material form matches.
  • Compare the ordering of the top few results before and after enabling usingReRank, and use similarity and limit to check whether key original text chunks are retained after similarity filtering and citation limit trimming.