Knowledge Base Retrieval for Research Project Annual Progress and Acceptance: Draft Materials and Hand Over Responsibilities

Research Progress: review retrieval for material handover. Check source versions, input mappings and the values received by downstream nodes.

What this category's data looks like

In the scenario of annual progress and acceptance of scientific research projects, the common materials are annual progress reports, mid-term review materials, and acceptance reports. Annual progress reports are updated periodically, and their fields include task name, indicators, completion status, date, and signature; mid-term review materials supplement phased results and budget execution; acceptance reports summarize all indicators, attachments, and receipts. When these three types of materials enter the knowledge base retrieval and recall function, each plays a different role: annual progress reports provide periodic milestones and progress descriptions, mid-term review materials provide the basis for phased verification, and acceptance reports provide the final fields and signature requirements. The material sources are mostly existing templates and historical archives, and the update rhythm is synchronized with project milestones. Field characteristics are concentrated in the name, quantity, date, version, and signature of the same record. These fields need to be fully recalled in retrieval candidates to support subsequent drafting and handover.

Configuration and implementation checks

This step is performed by the knowledge base retrieval service (retrieval node and search test), which outputs candidate snippets and similarity scores (after mode, merge, rerank, filter, and limit trimming). The draft materials that can be issued and the handover records are completed by subsequent nodes or manually.

ObjectCheckVerification action
Annual progress reportFields complete, responsible person clear, version and date consistentIn the search test, switch searchMode and check whether the candidates cover the task name, indicators, completion status, date, and signature fields
Mid-term review materialsThe name, quantity, and date of the same record do not match between the two materialsSearch using the same record name, compare the candidate snippets of the annual progress report and the mid-term review materials, and check whether the name, quantity, and date are consistent
Acceptance reportMissing signature or receipt, version not synchronizedRetrieve acceptance report candidates, check whether the signature and receipt fields appear in the cited text, and record the number of candidates and scores
Knowledge base retrieval serviceCandidate snippets and similarity scores undergo mode, merge, rerank, filter, and limit trimmingToggle rerank to compare the order of the first few items, adjust similarity to see filtered candidates, and check limit and cited text tokens

Three common errors

  • Phenomenon: The name and quantity of the same record do not match between the annual progress report and the mid-term review materials. Cause: The retrieval candidates do not cover both materials at the same time, and merge and rerank do not rank consistent fields first.
  • Phenomenon: The acceptance report lacks a signature or receipt, and the version is not synchronized. Cause: The candidate snippets only recall the main text, and the signature and receipt fields are not retained by the citation limit, leaving the handover record without a basis.
  • Phenomenon: The same question cannot be recalled when rephrased, and although there are many candidates, the ones ranked first are all irrelevant. Cause: Question optimization is not expanded, semantic and full-text recall are not merged, and rerank does not perform secondary sorting.

How to verify the setup

In the knowledge base search test, retrieve once with each synonymous question, compare the number of candidates and scores, and confirm whether the name, quantity, and date fields appear at the same time.

Compare the order of the first few items before and after toggling rerank, adjust similarity and limit, record the number of citations separately, and check whether the cited text tokens retain the signature and receipt fields.

  • Acceptance of this function: test once with each synonymously rewritten question, compare candidates and scores, then toggle rerank to see the order of the first few items; switch searchMode, adjust similarity and limit, record the number of candidates and scores, and check cited text tokens.
  • Business test: draft one according to the template and complete one handover, and see whether missing items are blocked.