What this category's data looks like
This page addresses the scenario of reviewing registration for professional and technical personnel qualification examinations. The materials include the registration form, education certificate, and work experience certificate. The registration form contains name, ID number, examination level, employer name, date, and signature; the education certificate contains graduating institution, major, certificate number, and issue date; the work experience certificate contains start and end dates, position, employer seal, and handler signature. Materials are updated by annual batch, and the name, quantity, and date of the same record may not match across different materials, with versions not synchronized or signatures and receipts missing. When entering this function, the registration form serves as the main record anchor, while the education certificate and work experience certificate serve as sources of basis entries, each participating in retrieval as original text fragments; after reranking, citation trimming and answer generation produce basis entries that can be traced back to the original text.
Configuration and implementation checks
This step is executed by the rerank model in the retrieval service, which outputs the sorted candidates and rerank scores. "Basis entries that can be traced back to the original text" are then completed by citation trimming and answer generation. Hybrid retrieval simultaneously runs the vector and full-text paths and merges the results; after merging, the scope is large and similarity filtering cannot be applied directly, so the rerank model is usually then used to sort and filter by rerank score.
| Object | Check | Verification action |
|---|---|---|
| Registration form | Fields, dates, and signatures must match the education certificate and work experience certificate | Check name, ID number, examination level, employer name, date, and signature; confirm that the name, quantity, and date of the same record are consistent across the two materials; check whether versions are synchronized and whether signatures or receipts are complete |
| Education certificate | Graduating institution, major, certificate number, and issue date must be consistent with the registration form | Check the certificate number and issue date; confirm that the major name is consistent with what is filled in on the registration form; check whether signatures or receipts are missing |
| Work experience certificate | Start and end dates, position, employer seal, and handler signature must be consistent with the registration form | Check the start and end dates and position; confirm that the employer seal and handler signature are complete; check whether versions are synchronized |
| Rerank model | Bound and used for sorting and filtering, outputting the sorted candidates and rerank scores | Compare the order and scores before and after reranking; check the number of candidates and scores; check the values of usingReRank, searchMode, limit, and similarity |
Three common errors
- Symptom: there are many candidates but the top few are irrelevant. Cause: after hybrid retrieval merging, the scope is large and rerank score filtering is not used, or the rerank model is not bound.
- Symptom: the name, quantity, and date of the same record do not match across the two materials. Cause: the versions of the registration form, education certificate, and work experience certificate are not synchronized, and signatures or receipts are missing.
- Symptom: the results are clearly biased toward keyword hits. Cause: the weight of the full-text path is too high, the vector path is not enabled, or the rerank score does not participate in filtering.
How to verify the setup
Acceptance of this function: compare the order and scores of the top three before and after enabling reranking, check the number of candidates and scores, and check the values of usingReRank, searchMode, limit, and similarity.
Business test: ask a cross-material basis question and see whether the answer provides a traceable source.
- Check the fields, dates, and signatures of the registration form, education certificate, and work experience certificate, confirm that the name, quantity, and date of the same record are consistent across the two materials, that versions are synchronized, and that signatures or receipts are complete.
- Compare the order and scores before and after reranking, check the number of candidates and scores, and check the values of
usingReRank,searchMode,limit, andsimilarity.