What this category's data looks like
For the pre-departure training and overseas safety reminders category, materials include pre-departure training courseware, safety reminder checklists, and accommodation contact lists. Sources are the project team and overseas affairs liaisons, and the update cadence rolls forward by batch and ad hoc reminders. Field characteristics center on names, quantities, dates, version numbers, and signed receipts. When entering knowledge base retrieval and recall, pre-departure training courseware handles process and specification explanations, safety reminder checklists handle scenario-based reminders, and accommodation contact lists handle contact and address verification. The three types of materials each provide candidate snippets for subsequent nodes or manual comparison of whether the names, quantities, and dates of the same record match across two materials, and to check whether versions are synchronized and whether signatures or receipts are complete.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate snippets and similarity scores (after pattern, merge, rerank, filter, and limit trimming). The exception list and review conclusions are then completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Pre-departure training courseware | Whether the names, quantities, and dates of the same record are consistent between the courseware and the safety reminder checklist, and whether versions are synchronized | In the search test, switch searchMode, retrieve once each with synonym-rewritten questions, record the number of candidates and scores, then toggle rerank on and off to compare the order of the top few results |
| Safety reminder checklist | Whether entries missing signatures or receipts can be retrieved and retain key snippets of the original text | Compare candidates before and after filtering with similarity, check the tokens and array count of the returned reference text, and confirm key passages have not been trimmed |
| Accommodation contact list | Whether the names and dates of the same accommodation record do not match between the contact list and the courseware, and whether versions are synchronized | Compare sorting before and after toggling usingReRank, check whether candidates contain both semantic and full-text results, trace back to the source material, and review again |
| Exception list and review conclusions | Exceptions are supported by original records and signed by the reviewer, and are routed to the responsible person for handling | Trace each candidate back to the original text of the courseware, checklist, or contact list according to the number of candidates recorded by limit, and verify dates, quantities, signatures, and receipts |
Three common errors
- Symptom: The names, quantities, and dates of the same record do not match between the courseware and the safety reminder checklist. Cause: The two materials are updated separately, without field-level comparison and version synchronization.
- Symptom: The accommodation contact list has been revised, but retrieval still recalls the old version of the contact. Cause: Versions are not synchronized, and candidates are not filtered by date and version.
- Symptom: The safety reminder checklist is missing signatures or receipts, and the exception cannot be closed. Cause: Signature fields were not retained when the material was imported, leaving the reviewer unable to verify.
How to verify the setup
Acceptance for this feature: test once each with synonym-rewritten questions, compare candidates and scores, then toggle rerank on and off to inspect the ordering of the top few results; at the same time record the number of candidates and scores, and check the tokens and array count of the reference text.
Business test: create an exception record, see whether it can be traced back to the source material, and verify the names, quantities, dates, signatures, and receipts in the courseware, checklist, and contact list.
- In the search test, switch
searchMode, use semantic, full-text, and hybrid retrieval respectively for the same question, and record differences in the number of candidates and scores. - Toggle
usingReRankto compare the order of the top few results, and usesimilarityandlimitto check the filtered and trimmed reference content.