What this category of data looks like
Data sources for this category include ERP material master data, melting furnaces and thermometers, spectrometers, MES heat records, mold management systems, customer drawings and technical specifications. Daily documents include foundry process cards, batching lists, heat records, mold histories, first article inspection records, material test reports, and nonconforming product review forms. Fields cover alloy batching ratios, melting temperatures, pouring parameters, defect types, heat numbers, mold numbers, and additional relevant items. Units include degrees Celsius, heat identification numbers, and other standard units. Data updates occur per heat, per batch, and daily. Single document structures are fixed, with unified field ordering.
What constraints these characteristics impose on document parsing and chunking
Document structures are fixed, but most fields consist of structured content. During chunking, retain complete field combinations for single heat or single batch. Do not split critical information such as batching ratios and temperature parameters for the same heat. Data updates happen per heat, per batch, and daily. Chunking must adapt to frequently updated heat records, and avoid including cross-batch content within a single chunk to prevent confusion. Data originates from multiple systems, so document formats vary. Custom separators must be used to match the structural boundaries of different documents. The accuracy of critical data directly impacts quality audit results. Chunking must not combine content from different heats or batches. Doing so will make it impossible to precisely match audit requirements during subsequent retrieval.
Configuration Settings
This configuration is based on FastGPT v4.17.0.
| Configuration Item | Recommended Setting | Rationale |
|---|---|---|
chunkSize | 800–1200 characters | Adapts to the content length of single heat or single batch in foundry documents, retains complete combinations of fields such as batching ratios and temperatures |
chunkSplitter | Custom separators, split by line or heat number | Adapts to structured line content in Excel and PDF documents, avoids combining content across lines or heats |
customPdfParse | Enabled | Accurately extracts table content from foundry process cards and material test reports, preserves field boundaries |
PARSE_FILE_TIMEOUT_SECONDS | 300–600 seconds | Adapts to parsing durations for large documents such as multiple heat records and mold histories, prevents timeout interruptions |
chunkSettingMode | Manual mode | Customizes separators for different document types, adapts to structured data from multiple sources |
Three Common Mistakes
- Scenario: When uploading Excel-format batching lists or heat records, multiple lines of a single record are merged into one
chunk. Cause:chunkSplitteris not configured to split by line or heat number. The default paragraph-based splitting fails to recognize Excel row boundaries. - Scenario: Some
chunks from material test reports or heat records cannot be retrieved. Cause:chunkSizeis set incorrectly relative to document content length, leading to critical fields such as alloy composition and temperature parameters being split across multiple chunks. Or custom separators are not configured to use heat numbers as boundaries. - Scenario: After uploading multiple PDF-format process cards or mold histories, information cannot be extracted per document. Cause: No configuration for document-level splitting. The default setting combines content from all uploaded documents, making it impossible to distinguish content from individual documents.
How to Verify Proper Configuration
- Upload a single Excel-format batching list, confirm that the number of split
chunks matches the number of rows in the original Excel file. - Upload multiple PDF-format process cards and material test reports, confirm that each
chunkcorresponds to content from a single document, with no cross-document merging. - Review parsed
chunkcontent, confirm that critical fields such as heat numbers and alloy batching ratios are not truncated. - Enter audit keywords such as alloy batching ratios and melting temperatures, confirm that corresponding
chunks are retrieved.
The values provided are common starting points and should be measured against the user's own samples.