Citations and Source Traceability for Journal Publication Licensing and Annual Verification: Trace Exceptions and Review Results

Journal Licensing: review citations for exception review. Check source versions, input mappings and the values received by downstream nodes.

What this category's data looks like

The materials for journal publication licenses and annual verification usually include three types: journal publication license, annual verification form, and rectification report. The license states the name, publication number, competent and sponsoring units, validity period, and issue date; the annual verification form states the verification year, staffing, publication status, and seal and signature; the rectification report states the problem items, rectification measures, completion date, and signature of the responsible person. The three types of materials are updated by year or batch, and after entering the knowledge base retrieval node, they are recalled as citation sources to trace the original materials corresponding to abnormal records. The license and the verification form should be consistent in name, publication number, and date, and the rectification report and the verification form should be consistent in problem items, quantity, and signed receipt. When material versions are not synchronized, or signatures or receipts are missing, abnormal records are difficult to trace back to the original text, requiring manual review and a conclusion.

Configuration and implementation checks

The citation output of the knowledge base retrieval node outputs only an array of citation contents, each containing an original text fragment and a source identifier, and the length may be 0. The abnormal list and review conclusion must be handled subsequently by AI nodes, code nodes, or humans. The citation content is output as an array, and the length may be 0; even if no content is found, the output chain will still run through.

ObjectCheckVerification action
Journal publication licenseCheck the license fields, issue date, and signature and seal, and compare item by item with the annual verification form to see whether the name, publication number, and validity period are consistentOpen the original license fragment in the citation content, compare it with the fields of the annual verification form, and record inconsistent items
Annual verification formCheck the verification year, number of personnel, publication status, signature, and receipt, and compare with the problem items and dates in the rectification reportUse the citation source to locate the original verification form, check the quantity, dates, and signatures field by field, and mark missing items
Rectification reportCheck the problem items, rectification measures, completion date, and signature of the responsible person, and compare with the problem list in the verification form for quantity and namesOpen the citation marker to trace back to the original rectification report, and check whether the number of items and the signed receipt are complete
Citation content outputThe number of returned items is consistent with the matched materials, and being empty is also normal; the number of citations is the array length, quoteMaxToken is the citation content budget, and the two are not compared for equalityRun a test with a question that has no matching materials, and see whether the array is empty while the chain runs through; record the number of citations in quoteList in responseData (non-streaming module results returned with detailed output enabled)

Three common errors

  • Phenomenon: The name, publication number, or date of the same record does not match between the license and the annual verification form. Cause: The two materials are filled in by different stages, versions are not synchronized, and field comparison was not performed before entering the knowledge base.
  • Phenomenon: The number and names of problem items in the rectification report and the verification form are inconsistent. Cause: After rectification, the verification form was not backfilled, or the backfilled version was not updated, so the citation fragments do not match the original text.
  • Phenomenon: The annual verification form lacks a signature or the rectification report lacks a receipt, so abnormal records cannot trace back to the complete original text. Cause: The scanned copy omitted the signature page, or the receipt was not stored in the knowledge base together with the materials.

How to verify the setup

Acceptance of this feature: ask a question with original-text evidence, and check whether the citation array and citation markers can trace back to the original text; then ask a question with no matching materials, and confirm that the array is empty while the chain runs through.

Business test: create an abnormal record, see whether it can be traced to the source material, and check and record the number of citations and the quoteMaxToken budget separately.

  • In the node, check whether the selected knowledge base collections and their vector models are consistent, and open the search parameter panel to check the values item by item.
  • Run a test with a question that has no matching materials, and see whether the output is empty while the chain continues; then open the citation markers to compare with the source documents, and check the citation fragments in quoteList in responseData.

References