What this category's data looks like
This category's data looks like this: For the review of registration for professional and technical personnel qualification examinations, the materials mainly consist of registration forms, academic qualification certificates, and work experience certificates, issued by personnel examination institutions and employers, and updated on a rolling basis with each examination batch. The registration form carries personal and application information, the academic qualification certificate verifies the field of study and level, and the work experience certificate verifies the start and end dates, position, and signature. The name, quantity, and dates of the same record in the three materials must be consistent, and signatures and receipts must be complete. When the materials enter the knowledge base for retrieval, each participates in recall as an independent fragment, the version ledger records the current version number and the destination of old versions, and references are updated synchronously when changes occur.
Configuration and implementation checks
This step is performed by the knowledge base retrieval service (retrieval node and search test), which outputs candidate fragments and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The "version ledger and change records" are completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Registration form | Whether the fields, dates, and signature are consistent with the academic qualification certificate and work experience certificate | In the search test, use synonymous questions to retrieve, check whether the name, quantity, and dates in the candidate fragments match, and record the number of candidates and scores |
| Academic qualification certificate | Whether the field of study, level, and graduation date are consistent with the registration form and work experience certificate | Switch searchMode to semantic, full-text, or hybrid, compare whether the candidates simultaneously contain fragments of both types of materials, and check signatures and receipts |
| Work experience certificate | Whether the start and end dates, position, and signature are consistent with the registration form and academic qualification certificate | Compare the ranking of the top few items before and after enabling usingReRank, and check whether key fragments are retained after similarity filtering and reference limit trimming |
| Version ledger and change records | The current version is unique, old versions are traceable, and references are updated synchronously | After changing one piece of content, check whether the version number and references are updated synchronously, and record the number of candidates under similarity and limit |
Three common errors
- Symptom: The name, quantity, and dates of the same record in the registration form and academic qualification certificate do not match. Cause: Multiple materials are entered separately, without field-level comparison and receipt verification.
- Symptom: The material content has been changed, but the reference still points to the old version. Cause: The version ledger is not updated synchronously, the old version's destination is not marked, and retrieval still recalls old fragments.
- Symptom: The work experience certificate lacks a signature or receipt, but candidate fragments are still recalled. Cause: Similarity filtering only looks at text matching and does not verify the completeness of signatures and receipts.
How to verify the setup
Acceptance of this feature: test once each with synonymously rewritten questions, compare candidates and scores, then toggle rerank on and off to see the ranking of the top few items; record the number of candidates and scores, and check the returns under similarity, limit, searchMode, and usingReRank.
Business test: change one piece of content and see whether the version number and references are updated synchronously.
- In the knowledge base search test, switch
searchModeand compare the candidate fragments and scores of the semantic, full-text, and hybrid modes. - Enable and disable
usingReRank, compare the ranking changes of the top few items, and record the number of candidates aftersimilarityfiltering and the reference text tokens.