Drafting Requirements and Design Documents for Backup Recovery and Disaster Recovery Drills: Document Parsing and Chunking

Daily documents for this category include backup policies, recovery drill reports, disaster recovery switchover plans, and data verification records.

What the Data for This Category Looks Like

Daily documents for this category include backup policies, recovery drill reports, disaster recovery switchover plans, and data verification records. Data sources include backup systems, database logs, object storage, and disaster recovery platforms. Document update frequencies are daily, monthly, and quarterly. Recovery drill reports are updated with each drill. Backup policies are revised quarterly. Document structures include structured fields such as Recovery Time Objective (RTO) and Recovery Point Objective (RPO), alongside unstructured descriptive content. Some documents contain cross-system configuration parameters and execution steps. Field units include seconds, hours, and megabytes.

Constraints Imposed on Document Parsing and Chunking

Documents in this category have diverse sources and formats. Formats include PDF, structured log exports, and plain-text backup reports. The parsing workflow must adapt to the content structures of different formats. Update frequencies vary widely. Batch-uploaded historical drill reports have large file sizes. The system must support large-file chunk processing. Key business fields such as recovery point confirmation information and data verification records must remain intact. They must not be split arbitrarily. Configuration content associated across systems must retain contextual connections. This avoids losing logical links between execution steps after chunking. This document is written based on FastGPT v4.17.0.

How to Configure Settings

Configuration ItemRecommended SettingRationale for This Setting
chunkSize800–1200 charactersAdapts to the mixed length of structured fields and unstructured descriptions in documents of this category. It prevents key business information from being split across different chunks
chunkSplitterSplit by title + paragraphPreserves the chapter hierarchy of disaster recovery documents. It ensures logical integrity of content such as recovery drill steps and backup policies
PARSE_FILE_TIMEOUT_SECONDS1200 secondsAdapts to the parsing time required for large batches of historical recovery drill reports. It prevents interruptions due to timeout during parsing of large-volume documents
UPLOAD_FILE_MAX_SIZE1000 MBCompatible with ultra-large-volume backup policy and drill report files exported from backup systems
customPdfParseEnabledOptimizes parsing effect for PDF-format disaster recovery documents commonly used in this category. It preserves tables and structured fields
chunkSettingModeBatch modeSupports simultaneous upload of multiple documents. It avoids interruptions caused by excessive single-parsing load

Three Common Configuration Mistakes

  • Phenomenon: Parsing interrupts when uploading large batches of recovery drill reports. Parsing progress cannot be restored after restarting the Docker service. Cause: The UPLOAD_FILE_MAX_SIZE configuration value is too small. It does not adapt to large-volume files exported from backup systems. chunkSettingMode batch mode is not enabled. This causes the single-parsing load to exceed the system limit.
  • Phenomenon: No parsing progress is shown when uploading a small-volume PDF disaster recovery switchover plan via the dialog box. No error logs are generated in the background. Cause: customPdfParse is not enabled. The default parsing engine cannot recognize structured tables and cross-system configuration fields in PDF documents.
  • Phenomenon: Key fields related to recovery point confirmation are split across different chunks in the chunked documents. Complete information cannot be associated during retrieval. Cause: chunkSplitter is configured to split by pure characters, rather than splitting by document title and paragraph hierarchy for logical grouping.

How to Verify Correct Configuration

  • Upload a single 100 MB PDF disaster recovery switchover plan. Check whether parsing completes within the preset timeout period. Verify that the PARSE_FILE_TIMEOUT_SECONDS configuration is reasonable.
  • Upload multiple backup policy documents in batch. Check whether parsing completes normally and content is written to the knowledge base. Confirm that chunkSettingMode batch mode is active.
  • Review chunked document content. Confirm that key business fields such as Recovery Time Objective, Recovery Point Objective, and data verification records are not split across chunks. Verify the effect of the chunkSplitter configuration.
  • Test uploading a 1000 MB historical recovery drill report. Confirm that the system allows the upload and starts the parsing process normally. Verify the UPLOAD_FILE_MAX_SIZE configuration value.

The values provided are common starting points and should be measured against the reader's own samples.

Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-10-19.