Reference only; verify against the target FastGPT release and deployment documentation.
What this category of data looks like
Internal document sources for integrated coal and power operations include production scheduling documents, equipment operation and maintenance logs, safety operation procedures, employee training manuals, monthly and annual production reports, and more. Update cadence varies by document type: operation and maintenance logs are updated daily, safety procedures are revised quarterly, employee manuals are updated annually, and annual reports are archived by fiscal year. Document structures include long text passages, structured tables (containing equipment numbers, operating parameters, energy consumption data), and paper archived documents in scanned image format. Fields and units include equipment rated power, coal consumption, operating duration, safety hazard level, and more. Each field has clear business measurement standards.
What constraints do these characteristics impose on the document parsing and chunking link
The mixed document structure of long text and structured tables requires the parsing and chunking process to balance contextual integrity and retention of structured data, avoiding splitting that breaks business logic connections. Scanned archived documents require the parsing process to have OCR recognition capabilities, otherwise valid text content cannot be extracted. Large single-file annual reports extend parsing time, so timeout parameters need to be adjusted to avoid task interruptions. Chunk granularity requirements vary by document type: short entry operation and maintenance logs and long passage production summaries require differentiated chunking configurations. Contextual connections for business identifiers such as equipment numbers must be retained to prevent business logic breaks from splitting.
How to set the configuration
| Configuration Item | Recommended Value | Rationale |
|---|---|---|
chunkSize | 800–1200 characters | Integrated coal and power documents include short entry operation and maintenance logs and long passage production summaries; this range balances contextual integrity and chunk granularity |
chunkSplitter | Split by section title + fixed length fallback | Integrated coal and power documents mostly follow unified section naming rules; splitting by title preserves business context, with fixed length fallback for overly long passages |
PARSE_FILE_TIMEOUT_SECONDS | 300–600 seconds | Large single-file annual production reports have large volume and long parsing time; this range prevents task timeout interruptions mid-process |
customPdfParse | Enabled | A large number of paper archived documents in scanned image format exist within internal coal and power operations; enabling this activates OCR recognition functionality |
UPLOAD_FILE_MAX_SIZE | 2000 MB | Single-file volume of annual archived documents for integrated coal and power projects can reach gigabyte scale; this upper limit is compatible with most business documents |
chunkSettingMode | Advanced mode | Chunk parameters need to be adjusted separately for structured tables and long text passages; advanced mode supports fine-grained configuration |
Three common mistakes
- Phenomenon: A
Cannot read properties of undefinederror occurs when calling document parsing. Cause:customPdfParseis not enabled, scanned documents cannot extract valid text, and empty fields are returned causing the error. - Phenomenon: A large amount of duplicate content appears in chunking results. Cause:
chunkSplitteris not configured to split by title, only fixed-length chunking is used, leading to repeated titles or generic passages across chapters being chunked multiple times. - Phenomenon: Insufficient business content matched in retrieval results. Cause:
chunkSizeis set too large, and advanced adjustments inchunkSettingModeare not enabled, making it impossible to split overly long production summary documents, leading to core content not being effectively chunked.
How to confirm the configuration is correct
- Upload a single 1000 MB coal and power equipment operation and maintenance log document; check whether the parsing task completes within the set timeout period.
- Upload a safety procedure document containing scanned images; check whether the parsed text content includes OCR-recognized text information.
- Enter the chunking configuration interface; confirm that
chunkSettingModeis set to advanced mode, andchunkSplitteris configured to split by section title. - Upload a short employee manual document; check whether the length of the chunking results matches the
chunkSizeset range.
The values given are common starting points and should be measured against the reader's own samples.
Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-09-28.