Knowledge Base Retrieval for Research Project Task Agreement Signing: Trace Exceptions and Review Results

Research Agreements: review retrieval for exception review. Check source versions, input mappings and the values received by downstream nodes.

What this category's data looks like

The materials for the research project task book signing scenario include three types: project task books, subject task breakdown tables, and budget books. The project task book is the main record, the subject task breakdown table carries the subject-level split, and the budget book carries funding categories and amounts. The materials come from a research management or project application system and stay synchronized with the signing process and version adjustments. The field characteristics center on names, quantities, dates, signatures, and receipts: names must be consistent with the project approval wording, quantities must correspond item by item with the breakdown table, dates must cover the signing, effective, and receipt milestones, and signatures must be complete. When the materials enter knowledge base retrieval, the task book serves as the main retrieval object, while the breakdown table and budget book serve as cross-verification sources, respectively carrying traceability for the subject and funding dimensions.

Configuration and implementation checks

This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The exception list and review conclusions are completed by subsequent nodes or manually.

ObjectCheckVerification action
Project task bookNames, dates, and signatures must be consistent with the project approval wording, and receipts must not be missingRetrieve task book entries in the search test, and check the name, date, and signature fields in the candidate chunks
Subject task breakdown tableSubject names and quantities must correspond item by item with the task book, and versions must be synchronizedRetrieve once each with synonym-rewritten questions, compare candidates and scores, and check whether the subject quantities match
Budget bookFunding categories and amounts must be consistent with the task book's budget wording, and dates must cover the signing milestoneSwitch searchMode to semantic, full-text, or hybrid, compare the number of candidates and scores, and check categories and dates
Exception list and review conclusionsEach exception has supporting original records, and reviewer signatures are completeCompare the top few rankings before and after enabling usingReRank, record the number of candidates and scores, and check the cited text tokens and limit trimming

Three common errors

  • Symptom: the subject name or quantity for the same record does not match between the task book and the breakdown table. Cause: the two materials' versions were not synchronized, and only one of them was updated after signing.
  • Symptom: the funding categories in the budget book are inconsistent with the task book's budget wording. Cause: after category adjustments, the task book was not written back, causing dates and amounts to be misaligned between the two materials.
  • Symptom: the exception list lacks supporting original records or reviewer signatures. Cause: receipts were not archived, the review step left no trace, and exceptions cannot be traced back to the source materials.

How to verify the setup

This feature's acceptance: test once each with synonym-rewritten questions, compare candidates and similarity scores, then toggle rerank to inspect the top few rankings, and record the number of candidates and scores.

Business test: create an exception record, see whether it can be traced back to the source materials, and check whether the exception list and review conclusions have supporting original records and signatures.

  • In the search test, switch retrieval modes, compare the number of candidates and scores, and check the name, quantity, date, and signature fields of the task book, breakdown table, and budget book.
  • Compare the top few rankings before and after enabling rerank, check the cited text tokens and limit trimming, record the number of candidates, and confirm that exceptions can be traced back to the source materials.