Knowledge Base Retrieval for Professional Qualification Exam Applications: Handle Multilingual Materials and Terminology

Professional Exams: review retrieval for multilingual work. Check source versions, input mappings and the values received by downstream nodes.

What this category's data looks like

This category's data looks like this: Professional and technical personnel vocational qualification examination registration review materials mainly consist of registration forms, academic qualification certificates, and work experience certificates. They come from submissions by applicants and issuance by their employers, and are updated by batch and by correction. The registration form contains name, ID number, examination subjects, and signature; the academic qualification certificate contains institution, major, certificate number, and date; the work experience certificate contains position, start and end dates, employer name, and receipt. After these three types of materials enter the knowledge base retrieval service, each participates in recall as candidate fragments: the registration form provides identity and subject fields, the academic qualification certificate provides academic qualifications and major terminology, and the work experience certificate provides years and date expressions. During multilingual materials and terminology processing, the same term must be consistent throughout the entire text and its translated name must be able to refer back to the original text. Differences in material forms require retrieval modes to match field characteristics.

Configuration and implementation checks

This step is performed by the knowledge base retrieval service (retrieval node and search test), outputting candidate fragments and similarity scores (after mode, merge, rerank, filter, and limit trimming). The unified terminology glossary and comparison draft are then completed by subsequent nodes or manually.

ObjectCheckVerification action
Registration formName, ID number, examination subjects, and signature field are consistent within the registration form, and dates match the academic qualification certificate and work experience certificateIn the search test, switch searchMode, test once each with synonymous questions, record the number of candidates and scores, and check the fields and signature in the registration form fragments
Academic qualification certificateInstitution, major, certificate number, and date are consistent within the academic qualification certificate, and the translated name can refer back to the original textCompare the order of the top few items before and after enabling rerank, check the impact of usingReRank, and check the terminology wording in the academic qualification certificate fragments
Work experience certificatePosition, start and end dates, employer name, and receipt are consistent within the certificate, and the quantity and dates match the registration formCheck whether the returned candidates include both semantic and full-text results, record similarity and limit, and check the dates and receipt in the certificate fragments
Unified terminology glossary and comparison draftThe same term is written consistently throughout the entire text, and the translated name can refer back to the original textSample three terms and check whether their wording is consistent throughout the entire text, check the tokens of the cited text, and record the number of array items separately

Three common errors

  • Symptom: The name and date of the same record do not match between the registration form and the work experience certificate. Cause: The versions of the two materials are not synchronized, or one lacks a signature and receipt.
  • Symptom: The major name and certificate number wording are inconsistent between the academic qualification certificate and the registration form. Cause: Terminology is not unified, and the translated name cannot refer back to the original text.
  • Symptom: There are many candidates, but the ones ranked at the front are all irrelevant. Cause: The retrieval mode does not match the material form, rerank is not enabled, or the similarity filter is too broad.

How to verify the setup

Acceptance of this feature: test once each with synonymously rewritten questions, compare candidates and scores, then toggle rerank on and off to observe the ordering of the top few items; record searchMode, usingReRank, similarity, limit, check the tokens of the cited text, and record the number of array items separately.

Business test: sample three terms and check whether their wording is consistent throughout the entire text

  • In the search test, switch searchMode and compare the number of candidates and scores across the semantic, full-text, and hybrid modes.
  • Enable and disable rerank, compare the order of the top few items; check similarity and limit to confirm the number of citations and the completeness of the content.