Data Characteristics
CAR-T cell therapy R&D data originates primarily from clinical trial reports, laboratory records, patent literature, and regulatory submissions. These documents update frequently, especially clinical trial data and laboratory reports, which may update weekly or monthly during a trial. Document structures are complex, containing large volumes of unstructured text, tabular data, gene sequence information, and images. Key fields include patient ID, treatment regimen, cell preparation batch, gene editing site, transduction efficiency, cell expansion rate, in vivo pharmacokinetic data, toxicity reaction level, efficacy evaluation indicators (e.g., complete response rate, progression-free survival), and various biomarker expression levels. Units involve percentages, molar concentrations, cell counts, time periods (days, weeks, months), and international standard units.
Constraints from Data Characteristics on Database and Operations
The complexity and high update frequency of CAR-T cell therapy R&D data demand higher scalability and real-time capabilities from databases. The mix of large volumes of unstructured text and tabular data requires databases with flexible data models, supporting integrated text retrieval and structured queries. Storing binary large objects (BLOBs) like gene sequence information and images increases pressure on storage systems. High-concurrency data write and read requirements, especially when aggregating multi-center clinical trial data, necessitate databases with high-performance concurrent processing capabilities. Data sensitivity (patient privacy, intellectual property) dictates strict data access control and auditing mechanisms. Additionally, data lifecycle management, version control, and disaster recovery strategies are crucial for ensuring the integrity and traceability of R&D data.
Configuration Guidelines
| Configuration Item | Recommended Value | Rationale |
|---|---|---|
DB_CONNECTION_POOL_SIZE | 50–100 | Handles high-concurrency data write and query demands |
UPLOAD_FILE_MAX_SIZE | 200 MB | Accommodates large clinical trial reports and image files |
PARSE_FILE_TIMEOUT_SECONDS | 600 seconds | Allows time for parsing complex PDFs and multi-page documents |
Chunk size | 800–1200 characters | Balances semantic completeness with retrieval efficiency |
Similarity threshold | Measured empirically, typically 0.75–0.85 | Ensures recall of relevant gene sequences, biomarkers, and other key information |
MILVUS_COLLECTION_SHARDS | 3–5 | Distributes vector retrieval load, improving query performance |
Common Pitfalls
- Database connection failures, displaying
{ "result": "Failed to connect to 192.168.xx.xx.:1433 - 38FBA17, typically indicate a database firewall blocking the port or a network configuration error. - System memory overflow errors when parsing large CAR-T R&D documents may occur if
PARSE_FILE_TIMEOUT_SECONDSis set too low or if system memory is insufficient for temporary storage of complex documents. - The database fails to start after migrating the FastGPT folder, even after deleting mounted files. This may be due to leftover old database lock files or configuration caches preventing a new instance from starting.
Verification Steps
- Perform a batch upload and parse of different types of CAR-T R&D documents (e.g., clinical reports, patents, laboratory records) to confirm all files process successfully.
- Simulate concurrent user queries via the FastGPT interface or API. Observe database connection counts and response times to ensure stable system operation under expected concurrency.
- Validate data backup and recovery procedures. Attempt a small-scale data recovery to confirm data integrity and recoverability.
- Check log systems for persistent database connection errors, memory warnings, or file parsing failures.
The values provided are common starting points. Measure them against your own samples.
Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-09-21.