Knowledge Base Retrieval for Modern Apprenticeships and Employer-Sponsored Classes: Trace Exceptions and Review Results

Apprenticeships: review retrieval for exception review. Compare the source records, required inputs and downstream results before handing the task over.

What this category's data looks like

Modern apprenticeship and order class management involves three types of materials: school-enterprise cooperation agreements, order class training plans, and master-apprentice mentoring records. School-enterprise cooperation agreements state the cooperating enterprise, major, term, and signatures; order class training plans state the class name, number of people, courses, and implementation date; master-apprentice mentoring records state the master and apprentice names, positions, mentoring period, and signed receipt. Materials are updated by semester or project milestone, and version numbers and effective dates must be kept in sync. When entering the knowledge base retrieval and recall function, the three types of materials serve as candidate fragment sources respectively, supporting original-text comparison for exception tracing and manual review. Retrieval results only provide candidate fragments and similarity scores, and do not directly generate exception lists and review conclusions.

Configuration and implementation checks

This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate fragments and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The "exception list and review conclusion" is completed subsequently by later nodes or manually.

ObjectCheckVerification action
School-enterprise cooperation agreementCheck whether the cooperating enterprise name, major, term, signatures, and date are consistent with the order class training planIn the search test, use the agreement's key fields as the query, switch searchMode to semantic, full-text, and hybrid and test each once, and record the number of candidates and scores
Order class training planCheck whether the class name, number of people, courses, implementation date, and version number are consistent with the master-apprentice mentoring recordsSearch using the training plan fields and date as the query, turn usingReRank on and off to compare the ranking of the top few results, and check whether candidates under the similarity threshold contain key passages
Master-apprentice mentoring recordCheck whether the master and apprentice names, positions, mentoring period, signatures, and receipts are complete and match the agreement and planSearch using the master's name and period as the query, check whether candidates contain both semantic and full-text results, record the array count and cited text tokens, and after limit trimming check the key original fragments
Exception record and source materialCheck whether the exception record can be traced to the original fields and signatures in the agreement, plan, or mentoring recordSearch separately using the name, quantity, and date in the exception record as queries, compare candidate fragments and scores, confirm the source matches, and then hand it to the responsible person for handling

Three common errors

  • Symptom: The name, number of people, or date of the same record does not match between the agreement and the training plan. Cause: The two materials are updated separately, without field-level comparison and version synchronization.
  • Symptom: The master-apprentice mentoring record lacks a signature or receipt, so the review conclusion cannot be written. Cause: The signature field was not validated when the material was archived, and the retrieval candidates also did not indicate the missing item.
  • Symptom: There are many candidates, but the ones ranked at the front are all irrelevant, and the source material cannot be traced. Cause: The retrieval mode does not match the material form, or reranking was not enabled for secondary sorting.

How to verify the setup

In the knowledge base search test, use the key fields of the agreement, plan, and mentoring record as queries, record the number of candidates and scores respectively, and check whether they contain original record support.

Compare item by item the name, quantity, and date of the same record in the two materials, check the version number and signed receipt, confirm the source matches, and then hand it to the responsible person for handling.

  • How to verify the setup

Acceptance of this function: test once each with synonym-rewritten queries, compare the number of candidates and scores, then turn reranking on and off to inspect the ranking of the top few results; at the same time switch searchMode, adjust similarity and limit, and observe and record the cited text tokens and array count respectively.

  • Business test: create an exception record and see whether it can be traced to the source material.