What Data for This Category Looks Like
Data for this category comes from registered process documents, raw material batch ledgers, DCS production control systems, weighing systems, LIMS laboratory information management systems, chromatography data systems, and QMS quality management systems. Daily generated documents include batch production records, material balance reports, reaction and purification records, cleaning validation records, impurity profile reports, and deviation and change documents. Data updates are triggered per production batch and per process step. Documents include fields such as reaction temperature, residence time, impurity content, solvent residue, and batch number. Units include degrees Celsius, hours, molar concentration, mass percentage, and other standard units.
Constraints for Citation Source and Traceability
Multi-source heterogeneous data sources require traceability to link batch numbers and parameters across different systems, to avoid cross-document matching errors. Batch-based data updates require traceability to bind unique production batch identifiers, to prevent cross-batch reference confusion. Complex document structures and multiple field attributes require precise matching of detailed content such as reaction steps and impurity items during traceability. Matching entire documents alone cannot meet traceability needs for detailed scenarios. Frequent updates and strict compliance requirements require that the traceability chain can be traced back to the original data collection node, to ensure the timeliness and compliance of citations.
Configuration Setup
This configuration is based on FastGPT v4.17.0.
| Configuration Item | Recommended Value Range | Rationale |
|---|---|---|
| Chunk Overlap Length | 150–200 characters | Matches continuous reaction step descriptions in process documents, avoids splitting that breaks parameter associations |
| Similarity Threshold | 0.75–0.85 | Filters low-match non-process-related documents, focuses on core fields such as impurities and yield |
quoteMaxToken | 800–1200 token | Accommodates complete reaction record or impurity profile report fragments, ensures cited content can trace full parameters |
responseData | Enable batch association mode | Binds production batches to citation sources, enables precise positioning of traceability chains |
detail | Enable original field output | Displays original fields such as chromatography data and weighing records, meets compliance traceability requirements |
Three Common Configuration Mistakes
- Phenomenon: After importing process documents, some batch production records do not generate question-answer pairs, and are stored directly in the knowledge base as original text. Cause: The chunk length is set too large, which overrides the system's question-answer pair generation trigger logic, causing the system to fail to complete splitting and parsing.
- Phenomenon: An error is prompted during the test stage after configuration is completed. The citation function runs normally after forced ignoring. Cause: The context verification logic of the test stage deviates from the parameter adaptation of the actual citation link, and does not affect the core traceability function.
- Phenomenon: When initiating a process query, only one citation from the knowledge base document is returned, and multi-step reaction related records cannot be associated. Cause: The single search limit is set too low, which does not cover the number of related documents for multi-step processes, leading to limited recall range.
How to Verify Correct Configuration
- Import a complete set of batch production records and impurity profile reports, check whether the knowledge base chunk results retain the integrity of core fields such as reaction parameters and impurity content.
- Initiate a query that includes a specific batch number, confirm that the returned citation content includes the bound batch identifier and original data source.
- Adjust the
quoteMaxTokenparameter range, verify whether the length of the cited fragment matches the single-step description range of the process document. - After enabling the
responseDatamode, check whether the citation result includes the upload time and system source tag of the original document.
The values provided here are common starting points, and should be evaluated against applicable samples.