What this category's data looks like
The external authorization and knowledge base retrieval recall for occupational skill level certification social evaluation draw on materials from the evaluation implementation plan, candidate registration forms, and assessor dispatch forms. The implementation plan enters the knowledge base as the source document for the authorization scope and evaluation process, while the registration forms and dispatch forms serve as the verification source documents for identity and dispatch relationships. The update cadence follows certification batches and authorization changes, and the field characteristics center on name, occupation (work type), level, date, and signature fields. Before the external entry point is opened, the three types of materials must be aligned by the same record for name, quantity, and date, with signatures or receipts complete. During retrieval recall, the materials are split into candidate chunks, and the authorization scope and visible identity are generated by subsequent nodes or manually based on these; retrieval itself does not produce authorization results.
Configuration and implementation checks
The knowledge base retrieval service (retrieval node and search test) only outputs candidate chunks and similarity scores (after mode, merge, rerank, filter, and limit trimming), and the externally available entry point and authorization scope must be handled by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Evaluation implementation plan | Name, occupation (work type), level, date, and signature fields must be consistent with the registration form | In the search test, switch searchMode and check whether the candidate chunks cover the authorization scope and evaluation process fields in the plan |
| Candidate registration form | If the name, quantity, and date for the same record do not match between the plan and the registration form, it is deemed inconsistent | Initiate synonymous questions with a restricted identity, record the number of candidate items and the similarity score, and confirm that the visible scope matches the registration identity |
| Assessor dispatch form | The assessor name, date, and signature or receipt in the dispatch form must be synchronized with the plan version | Compare the ranking of the top few items before and after enabling usingReRank, and check whether the dispatch records fall within the authorized visible scope |
| Citation limit trimming | After trimming, key chunks from the original text are still retained, and the array length is recorded separately | Check the tokens of the cited text and the limit setting, and do not equate the array length with the citation content budget |
Three common errors
- Symptom: The same candidate's name or date does not match between the registration form and the implementation plan. Cause: The two materials were entered separately and were not aligned by the same record for name, quantity, and date.
- Symptom: The assessor dispatch form lacks a signature or receipt, yet the authorization scope is still opened. Cause: The version was not synchronized, the dispatch form was not updated with the plan, and the signature field was not checked.
- Symptom: The same question phrased differently cannot be recalled, and although there are many candidates, the top-ranked ones are irrelevant. Cause: The retrieval mode does not match the material form, rerank is not enabled, or the similarity filter is too strict.
How to verify the setup
Acceptance for this feature: Test once each with synonymously rewritten questions, compare the candidates and similarity scores, then toggle usingReRank to observe the ranking of the top few items, and record the number of candidates and limit.
Business test: Access once with a restricted identity, check whether the visible scope matches the setting, and ensure unauthorized content is not visible.
- In the knowledge base search test, switch
searchModeand compare the candidate chunks and scores returned by the semantic, full-text, and hybrid modes. - Check the tokens of the cited text and the array length, and confirm that key chunks from the original text are still retained after similarity filtering and citation limit trimming.