What this category's data looks like
This page addresses knowledge base retrieval and recall for peer review organizations in authorized access and external service scenarios. The materials come from three types of business materials: review invitations, expert review comments, and author revision notes. They enter the knowledge base in batches, and the update cadence advances with review rounds. Fields include manuscript name, review round, expert name, comment date, revision note items, and signature or receipt status. When entering the retrieval function, review invitations provide the correspondence between manuscripts and experts, expert review comments provide review conclusions and dates, and author revision notes provide item-by-item responses and version numbers. Together, the three types of materials constitute the basis for the visible scope of authorized access, and the retrieval results determine which candidate snippets are displayed at the external entry point.
Configuration and implementation checks
The knowledge base retrieval service (retrieval node and search test) outputs only candidate snippets and similarity scores (after mode, merge, rerank, filter, and limit trimming). The externally facing entry point and authorization scope must be handled by subsequent nodes or manually. The retrieval node is responsible for selecting semantic, full-text, or hybrid recall according to searchMode, performing multi-path merging and secondary ranking via usingReRank, then filtering by similarity and trimming by citation limit, to obtain the citation content passed to the model.
| Object | Check | Verification action |
|---|---|---|
| Review invitation | Fields: manuscript name, expert name, invitation date, signature or receipt status; the name and date of the same manuscript in two materials must be consistent | In the knowledge base search test, switch searchMode and check whether the candidate snippets cover both the invitation and receipt fields |
| Expert review comments | Fields: review round, comment date, review conclusion, signature status; when versions are not synchronized, the date and round do not match | Test once each with synonymous questions, record the number of candidates and scores, and observe whether key comment paragraphs are retained after similarity filtering |
| Author revision notes | Fields: revision items, corresponding comment numbers, revision date, version number; the number of items must correspond one by one with the comment numbers | Turn usingReRank on and off to compare the ranking of the first few items, and confirm that the association between revision notes and comment numbers is not misaligned |
| Restricted identity entry | The visitor identity matches the visible scope, and unauthorized content is not visible; the number of citations is recorded separately by array length | Access once with a restricted identity, check the number of candidate array items and the citation text tokens, and do not compare the two as equal |
Three common errors
- Symptom: the name and date of the same manuscript do not match between the review invitation and the expert review comments. Cause: the two materials are imported separately, versions are not synchronized, and retrieval candidates are difficult to distinguish after mixed ranking.
- Symptom: the number of items in the author revision notes does not match the comment numbers. Cause: after the revision notes are updated, the associated fields are not written back, and matching during recall uses the old version.
- Symptom: review comments lacking a signature or receipt still appear in external candidate snippets. Cause: the visible scope is not filtered by signature status, and retrieval results directly enter subsequent nodes.
How to verify the setup
Acceptance for this feature: test once each with synonymously rewritten questions, compare candidates and scores, then toggle rerank on and off to observe the ranking of the first few items; record the number of candidates and scores, and check the actual effects of searchMode, similarity, and usingReRank.
Business test: access once with a restricted identity and see whether the visible scope matches the setting; unauthorized content is not visible, the number of citations is recorded separately by array length, and the citation text tokens are checked separately.
- In the knowledge base search test, switch
searchModeand compare candidate snippets and scores under the semantic, full-text, and hybrid modes. - Turn
usingReRankon and off, compare changes in the ranking of the first few items, and check whether key original snippets are retained aftersimilarityfiltering.