What this category's data looks like
This page focuses on business basis queries in enterprise independent skilled talent evaluation business. The materials involved include enterprise evaluation filing forms, evaluation specifications, and candidate rosters. The filing form records the evaluation agency and filing date; the evaluation specification states the occupational direction and assessment method; the roster registers candidate names, ID numbers, and declared levels. The three types of materials are archived by batch, and each filing or candidate change forms a new version. The field characteristics are tabular, containing signature and receipt columns. When entering this function, the filing form and evaluation specification serve as basis sources, and the roster serves as personnel supporting evidence. All three are simultaneously recalled in hybrid retrieval, and after merging and reranking, they are used for citation trimming and answer generation, ultimately forming basis entries that can be traced back to the original text.
Configuration and implementation checks
This step is executed by the rerank model in the retrieval service, outputting ranked candidates and rerank scores. The basis entries that can be traced back to the original text are then completed by citation trimming and answer generation. Hybrid retrieval simultaneously runs vector and full-text paths and merges the results. After merging, the scope is large and similarity filtering cannot be directly applied, so the rerank model is usually used again to sort and filter by rerank score.
| Object | Check | Verification action |
|---|---|---|
| Enterprise evaluation filing form | The basis comes from the institution’s materials, the version is current, and the entries can be matched to the original text; check the filing form fields, date, and signature | In the search parameters, check whether searchMode enables both vector and full-text paths at the same time, and check whether candidates come from both paths |
| Evaluation specification | The basis comes from the institution’s materials, the version is current, and the entries can be matched to the original text; check the evaluation specification fields, date, and signature | Compare the ranking and scores before and after reranking, confirm that specification entries remain in the top candidates after reranking, and record the number of candidates and scores |
| Candidate roster | The basis comes from the institution’s materials, the version is current, and the entries can be matched to the original text; check the roster fields, date, and signature | Check whether the names, quantities, and dates in the roster are consistent with the filing form and evaluation specification, and check whether signatures or receipts are complete |
| Rerank model | Bound and used for sorting and filtering; check the coordination of usingReRank and limit | Compare the order and scores of the top three before and after enabling reranking, confirm that rerank scores are used for filtering, and do not rewrite the original text |
Three common errors
- Phenomenon: The same candidate name does not match between the roster and the filing form. Cause: The two materials were not entered with a unified name, or one of them is an old version that has not been synchronized.
- Phenomenon: The number of assessment methods in the evaluation specification is inconsistent with the filing form record. Cause: The filing form was not synchronized after the specification was updated, or missing signatures and receipts make the version impossible to confirm.
- Phenomenon: There are many candidates but the top few are irrelevant. Cause: The merged scope of hybrid retrieval is large, and the rerank model was not enabled or filtering by rerank score was not applied.
How to verify the setup
Acceptance for this function: compare the order and scores of the top three before and after enabling reranking, check that usingReRank takes effect, and that limit and similarity status values only record the number of candidates and scores.
Business test: ask a cross-material basis question, see whether the answer provides traceable sources, and check that the number of citations and citation text tokens are recorded separately.
- In the search parameters, check the two-path switches of
searchMode, the binding status ofusingReRank, and compare the ranking and scores before and after reranking. - Check the fields, dates, and signatures of the filing form, evaluation specification, and roster item by item, confirming that the version is current and the entries can be traced back to the original text.