What this category's data looks like
Enterprise independent skilled talent evaluation materials include evaluation filing forms, evaluation specifications, and candidate rosters. The filing form records the evaluation agency, occupation and level, filing date, and signature; the evaluation specification records the assessment method, scoring criteria, and version date; the roster records candidate names, ID numbers, declared levels, and employer seals. The three types of materials play different roles in knowledge base retrieval and recall: the filing form and evaluation specification are retrieved as rule bases, while the roster is retrieved as personnel details. Materials are updated by batch, and the version date and signature fields are field characteristics. After materials enter the retrieval node, they first undergo question optimization and expansion, then candidates are recalled by semantic, full-text, or hybrid mode, and finally candidate snippets and similarity scores are output.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate snippets and similarity scores (after mode, merge, rerank, filter, and limit trimming). The handover-ready deployment status and operation records are completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Evaluation filing form | Whether the occupation name, level, filing date, and signature in the filing form and evaluation specification match | In the search test, search the occupation name and level, check whether the returned candidates hit both the filing form and evaluation specification, and record the number of candidates and scores |
| Evaluation specification | Whether the specification version number is synchronized with the filing form version, and whether the scoring criteria dates are consistent | Switch searchMode to full-text, search the version number and date, compare the version fields in the candidate snippets, and record the number of candidates and scores |
| Candidate roster | Whether the number of candidates, declared levels, and employer seals in the roster are consistent with the filing form and evaluation specification | Search candidate names and declared levels, check whether the candidate snippets contain the corresponding records in the roster and filing form, and record the number of candidates and scores |
| Deployment status and operation records | Whether version, connection, and task records are consistent, and whether missing signatures or receipts are marked | Check item by item according to the handover sheet, view the number of candidates under the similarity threshold and the tokens of cited text after limit trimming, and toggle usingReRank to compare the ranking of the top few items |
Three common errors
- Symptom: The name or number of the same candidate does not match between the roster and the filing form. Cause: The two materials were updated in different batches and were not checked for synchronization by version date.
- Symptom: The evaluation specification version number is not synchronized with the filing form version, and retrieval returns old-version snippets. Cause: The version field was not marked during knowledge base import, and retrieval was not filtered by version.
- Symptom: The filing form lacks a signature or receipt, and records are missing during item-by-item verification of the handover sheet. Cause: The scanned material does not include the signature page, and the retrieval candidates do not cover that field.
How to verify the setup
Acceptance of this feature: test once each with synonym-rewritten questions, compare candidates and scores, then toggle rerank to observe the ranking of the top few items.
Business test: check item by item according to the handover sheet once, and see which record is missing.
- In the search test, switch
searchModeand compare the number of candidates and scores across semantic, full-text, and hybrid modes. - View the number of candidates after
similarityfiltering, separately record the tokens of cited text afterlimittrimming, and toggleusingReRankto compare ranking.