Document Parsing and Chunking for District Teaching Research and Classroom Reviews: Maintain Document Versions and Changes

Teaching Reviews: review parsing for version tracking. Compare the source records, required inputs and downstream results before handing the task over.

What this category's data looks like

Materials for district and county teaching research activities and classroom observation and evaluation include three types: teaching research activity notices, classroom observation records, and classroom evaluation minutes. Notices contain the activity theme, time and location, scope of participation, and receipt requirements; classroom observation records contain the instructor, class, subject, observation dimensions, and classroom transcript; classroom evaluation minutes contain evaluation points, improvement suggestions, and signature confirmation. Materials are updated on a semester or activity cycle basis, and the same activity often produces three texts—notice, record, and minutes—whose fields and dates must correspond to one another. After materials enter parsing and chunking, notices are used to build the activity index, classroom observation records are used to build the classroom observation index, and classroom evaluation minutes are used to build the evaluation conclusion index, each serving as a retrieval entry point.

Configuration and implementation checks

This step is executed by the parsing and training task (server-side task), which outputs data rows and index statuses (parsed, indexing, indexed). "Version ledger and change records" are then completed by retrieval and subsequent processing.

ObjectCheckVerification action
Teaching research activity noticeWhether the activity name, date, scope of participation, and receipt requirements are consistent with the classroom observation records and classroom evaluation minutesCheck the notice fields against the other two materials to confirm that the dates and names match
Classroom observation recordWhether the instructor, class, subject, and observation dimensions correspond to the evaluation targets in the classroom evaluation minutesCompare the classroom observation record with the classroom evaluation minutes item by item to confirm that the quantities and dates are consistent
Classroom evaluation minutesWhether the evaluation points, improvement suggestions, and signature confirmation are complete, and whether they correspond to the notice receiptCheck the signatures and receipts to confirm that the current version is unique and that old versions are traceable
Data rowWhether it is in one of the three states parsed, indexing, indexed and is consistent with the interface displayOpen the data row to check the status and confirm the correspondence of chunkSize, chunkSplitter, and trainingType

Three common errors

  • Symptom: The name, quantity, and date of the same record do not match across two materials. Cause: The notice, record, and minutes are each updated independently, without cross-checking.
  • Symptom: Versions are not synchronized, and old versions are still hit by retrieval. Cause: When changing models, only data with completed indexing is rebuilt; data pending indexing does not participate in the rebuild chain.
  • Symptom: Signatures or receipts are missing, and the classroom evaluation minutes cannot be confirmed. Cause: When materials enter parsing and chunking, the signature fields and receipt status are not validated.

How to verify the setup

This feature's acceptance test: upload one material and observe the data row status transitions and the coverage scope of the rebuild task.

Business test: change one piece of content and see whether the version number and references are updated synchronously.

  • Open the data row to check whether the status is parsed, indexing, or indexed, and confirm that it is consistent with the interface display
  • Check the identity identifiers of the file record and the data row separately to confirm that their respective identities are distinguishable