What this category's data looks like
Journal publication license and annual verification materials consist mainly of journal publication licenses, annual verification forms, and rectification reports. Their sources are approval receipts and annual submission documents, and their update cadence advances with license changes and annual verification cycles. When these materials enter the knowledge base retrieval and recall feature, the license plays the anchoring role for the entity and license scope fields, the annual verification form plays the comparison role for annual data and verification conclusion fields, and the rectification report plays the traceability role for problem items, rectification dates, and signed receipt fields. Field characteristics are concentrated in four categories: names, quantities, dates, and signed receipts. The same record often has mismatched names, quantities, or dates across two materials, and unsynchronized versions and missing signed receipts are also common. After these materials enter retrieval, candidate chunks and similarity scores are first formed, and are then used by subsequent nodes or by humans to generate handover-ready deployment status and operation records.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after pattern, merge, re-rank, filter, and upper-limit trimming). Handover-ready deployment status and operation records are then completed by subsequent nodes or by humans.
| Object | Check | Verification action |
|---|---|---|
| Journal publication license | Names, quantities, dates, and signature fields must align item by item with the annual verification form | In the search test, switch searchMode to semantic, full-text, or hybrid, record the number of candidates and scores, then check against the license fields |
| Annual verification form | Annual data, verification conclusions, and dates must be consistent with the license and rectification report | Turn usingReRank on and off to compare the ranking of the top few results, and check the same record in the annual verification form and the license against the handover sheet |
| Rectification report | Problem items, rectification dates, and signed receipts must correspond to the annual verification form | Adjust similarity to observe changes in candidates, record the tokens of the referenced text and the number of array items, and check the rectification report signature and receipt |
| Deployment status and operation records | Version, connection, and task records must be consistent | Check item by item once against the handover sheet, and confirm that the number of candidates and scores, the number of references, and the reference content budget are each recorded |
Three common errors
- Symptom: The same record has mismatched names, quantities, or dates in the license and the annual verification form. Cause: The two materials' versions are not synchronized, and retrieval candidates do not cover the latest fields.
- Symptom: The rectification report lacks a signature or receipt, and the handover sheet check cannot be closed. Cause: The scanned materials are incomplete, and candidate chunks do not include the signature page.
- Symptom: There are many candidates, but the top-ranked ones are all irrelevant, and the answer lacks key paragraphs. Cause: The retrieval mode does not match the material form, re-ranking is not enabled, or similarity filtering is too broad.
How to verify the setup
Feature acceptance: test once each with synonym-rewritten questions, compare candidates and scores, then turn re-ranking on and off to inspect the ranking of the top few results, and record the number of candidates and scores.
Business testing: check item by item once against the handover sheet, see which record is missing, and confirm that version, connection, and task records are consistent.
- In the knowledge base search test, switch
searchModeand compare the number of candidates and scores across semantic, full-text, and hybrid modes. - Turn
usingReRankon and off to compare the ranking of the top few results, and after adjustingsimilarity, record the tokens of the referenced text and the number of array items.