Cross-Review of Technical Documents for Process Changes and Engineering Changes: Knowledge Base Retrieval and Recall

The core data for this category comes from manufacturing enterprise PLM, ERP, and MES systems, as well as supplier materials, validation test

What the data for this category looks like

The core data for this category comes from manufacturing enterprise PLM, ERP, and MES systems, as well as supplier materials, validation test documents, and customer special requirement documents. Daily generated documents include ECN/ECR forms, change assessment reports, drawings and BOM version files, process validation reports, transition plans, inventory disposal lists, and customer approval documents. Fields include version numbers, change nodes, material codes, process parameters, approval status, and more. Updates are triggered irregularly with each change, with no fixed cycle.

What constraints these characteristics impose on knowledge base retrieval and recall

Heterogeneous data from multiple sources (structured BOMs, semi-structured process records, unstructured drawings and PDF reports) requires retrieval that supports content parsing for different formats. Irregular change-triggered updates require support for incremental synchronization and real-time recall. Documents contain professional fields such as tables, long text, and version identifiers, requiring retrieval semantic matching accuracy aligned with industry terminology. A single change involves multiple types of related documents, requiring precise recall of all relevant items to avoid missing documents with chain effects. Cross-data-source retrieval for customer special requirements and supplier materials requires establishing dataset associations across different systems.

How to configure the settings

In FastGPT v4.17.0, the following configuration items can be used to adapt the retrieval requirements for this category:

Configuration ItemRecommended ValueRationale
similarity0.72–0.85Matches semantic consistency for professional fields such as process parameters and version numbers, filtering low-relevance non-change documents
limitTop 8 entriesCovers multiple types of documents involved in a single change (BOMs, drawings, validation reports) while avoiding redundant recall content
searchModemixedRecallCombines keyword matching and semantic retrieval to adapt to mixed queries of material codes and process descriptions in ECN forms
usingReRankEnabledRe-ranks recall results by change relevance, prioritizing returning version documents and validation reports directly related to the current change
datasetSearchUsingExtensionQueryEnabledAutomatically expands query terms based on the current change topic, covering associated data sources such as customer special requirements and supplier materials
collectionIdsSpecify the dedicated dataset ID for change managementRestrict the retrieval scope to only change management-related documents, avoiding mixing in non-relevant data from other categories

Three common configuration errors

  • Uploaded ECN and BOM tables cannot be fully chunked and recalled, with material codes and process parameters in the tables missing from retrieval results. This occurs because no applicable chunking rules are configured for table documents, leading to truncated or incorrectly split table content.
  • A "no knowledge base selected" prompt appears during retrieval, and no change-related documents are returned. This occurs because the collectionIds of the corresponding change management dataset are not specified in the retrieval entry, or target documents are not bound to the correct dataset.
  • Old and new version documents are mixed in recall results, with the latest validation reports and transition plans not prioritized. This occurs because usingReRank is not enabled, or the similarity threshold is set too low to distinguish version relevance.

How to verify the configuration is correct

  • Upload an ECN table and a BOM version document, perform a retrieval based on the current change topic, and check whether the table content is fully recalled and chunked reasonably.
  • Specify the collectionIds of the dedicated change management dataset in the retrieval interface, and confirm that the "no knowledge base selected" prompt does not appear during retrieval.
  • Compare the order of recall results when usingReRank is enabled and disabled, and confirm that version documents and process validation reports are displayed first.
  • Adjust the similarity parameter range, and check whether low-relevance non-change documents are effectively filtered.

The values provided are common starting points and should be evaluated against the reader's own samples.