Context and Token Budgets for District Teaching Research and Classroom Reviews: Compare Documents and Locate Differences

Teaching Reviews: review context & tokens for document checks. Check source versions, input mappings and the values received by downstream nodes.

What this category's data looks like

In the scenario of district and county teaching research activities and classroom observation/evaluation, materials mainly come from three types: teaching research activity notices, classroom observation records, and classroom evaluation minutes. Activity notices are issued by the organizing party before the activity and contain the activity name, time, location, participants, and agenda; classroom observation records are filled in by observers on site in the classroom and contain the instructor, class, subject, observation time, and observation points; classroom evaluation minutes are compiled by the recorder of the evaluation session and contain the evaluation time, participants, review points, and signature field. The three types of materials have different update rhythms: notices are finalized before the activity, classroom observation records are generated during class, and classroom evaluation minutes are added after the meeting and sent for signature. Field characteristics are concentrated in four categories: name, quantity, date, and signature receipt. The same record often appears in two materials with different name wording, different quantity calibers, inconsistent dates, unsynchronized versions, or missing signatures. When entering this function, the notice serves as the baseline material, and the classroom observation records and classroom evaluation minutes serve as comparison materials, used to locate field discrepancies and generate a discrepancy list.

Configuration and implementation checks

This step is executed by application settings (response limit, etc.), which output the length of a single answer and the range of context that can be accommodated. The "discrepancy list" is then completed by the model. The response limit is controlled by a slider for the length of a single answer; if set too low, the answer will be truncated, and if set too high, consumption will increase.

ObjectCheckVerification action
Response limitMatches the answer length required by the pageCheck the switch and slider position in application settings, and confirm the single-answer length limit corresponding to maxResponse
Truncation behaviorThe ending of a longer answer is completeAsk a question that requires a long answer, see whether the ending breaks off mid-sentence, and check the budget allocation of maxContext and quoteMaxToken
Runtime consumptionSingle-run usage changes after the limit is adjustedCompare the usage of two runs, and confirm whether single-run consumption changes with answer length after adjustment
Classroom observation records and classroom evaluation minutesThe name, quantity, and date of the same record are consistentCompare the instructor, class, observation time, and review points of the two materials field by field, and mark inconsistent items

Three common errors

  • Phenomenon: the same record has different name wording in the activity notice and the classroom observation record, and the quantity calibers are also inconsistent. Cause: the two types of materials are filled in by different personnel, and the field calibers have not been unified.
  • Phenomenon: the version of the classroom evaluation minutes is not synchronized, and the date does not match the classroom observation record. Cause: when adding records after the meeting, the finalized notice was not used as the baseline, and versions were retained separately.
  • Phenomenon: the classroom evaluation minutes lack a signature or receipt, and the discrepancy list cannot be submitted to the reviewer for confirmation. Cause: the signature submission step is not closed-loop, and the signature field and receipt are not archived with the materials.

How to verify the setup

This function's acceptance: ask a question that requires a long answer, see whether the ending is complete, and confirm that the response limit matches the budget of maxResponse, maxContext, and quoteMaxToken.

Business test: use a real record to find fields inconsistent with the ledger, and check the name, quantity, date, and signature receipt item by item.

  • Check the response limit switch and slider position in application settings, and confirm that the single-answer length matches the page requirements.
  • Compare the name, quantity, date, and signature of the activity notice, classroom observation records, and classroom evaluation minutes field by field, mark discrepancies, and write them back after confirmation by the reviewer.