This document is written based on FastGPT v4.17.0.
What this category of data looks like
The data sources for this category include DCS/SIS systems, online analyzers, LIMS laboratory management system, equipment condition monitoring module, energy metering system, and raw material tank monitoring module. Data update frequencies cover three levels: real-time, per shift, and daily. Routine documents include operating procedures, process index cards, DCS trend charts, laboratory reports, interlock bypass records, special work permits, and shift logs. Most document fields contain process parameters, equipment condition values, work approval status, and other information. Some fields use standard industrial units such as ℃, MPa, m³/h.
What constraints do these characteristics impose on the knowledge base retrieval and recall link
Real-time updated DCS and equipment condition data require the retrieval pipeline to support near-real-time data synchronization. This prevents retrieval results from lagging behind on-site conditions. Documents with multiple update frequencies need layered update strategies. These strategies ensure high-frequency documents refresh promptly, and low-frequency documents sync as needed. Diverse document types, from static operating procedures to dynamic DCS trend charts, need differentiated retrieval weight configurations. Fields with standard industrial units need unit matching logic during retrieval. This eliminates parameter ambiguity. High-risk documents such as interlock bypass records need permission filtering rules. These rules ensure only authorized users can access retrieval results.
How to set configurations
| Configuration Item | Recommended Setting | Rationale |
|---|---|---|
similarity | 0.75–0.85 | Meets the precision requirements for basic chemical process parameters, filters low-relevance non-process documents |
limit | Top 8 entries | Covers the number of common knowledge entries for team patrols and maintenance, avoids context overload |
usingReRank | Enabled | Filters redundant results from multi-index recall, improves ranking priority of highly relevant fragments |
searchMode | embedding | Adapts to unstructured text retrieval needs for process parameters and equipment status |
datasetSearchUsingExtensionQuery | Enabled | Expands semantic boundaries of inspection and maintenance questions, covers synonymous operation expressions |
Three common configuration mistakes
First mistake
Phenomenon: The same document chunk appears multiple times in retrieval results, or recalled results deviate significantly from query semantics. Cause: Unified index grouping rules are not configured for multi-source documents in basic chemical production. This leads to repeated recall of the same chunk across multiple indexes.
Second mistake
Phenomenon: Retrieval results are empty or reference fragments are missing after enabling usingReRank. Cause: The similarity threshold is set too high. This results in insufficient initial recall candidate sets, with no valid fragments available for the re-ranking step.
Third mistake
Phenomenon: Confidential documents such as special work permits and interlock bypass records are retrieved by unauthorized users. Cause: Permission filtering rules based on document type are not configured. This skips permission verification during knowledge base retrieval.
How to confirm the configuration is correct
- Submit queries related to equipment inspection. Check if retrieval result document types cover category documents such as operating procedures, DCS trend charts, and maintenance records.
- Enable
usingReRank, then compare initial recall results with re-ranked results. Confirm that the ranking priority of highly relevant fragments meets business expectations. - Use an unauthorized test account to submit queries for high-risk documents. Confirm that no relevant results are returned.
- Adjust the
similaritythreshold range. Verify that retrieval result relevance matches the precision requirements for process parameters.
The values provided are common starting points and should be measured against the reader's own samples.