What this category's data looks like
Enterprise sales product training materials typically include three types: product manuals, sales response scripts, and channel training schedules. Product manuals record product name, model, quantity, effective date, and version number, and are issued by the product department; sales response scripts record selling points, response scripts, and applicable versions, and are maintained by sales operations; channel training schedules record course name, start date, participating channels, and receipt signatures. The three types of materials have different update rhythms: manuals are revised with product iterations, response scripts are fine-tuned with channel feedback, and schedules are planned quarterly. When materials enter this feature, product manuals and response scripts serve as basis sources, and schedules serve as training record sources, jointly supporting cross-material basis queries. Field characteristics are concentrated in name, quantity, date, version, and signature, and need to be compared item by item.
Configuration and implementation checks
This step is executed by the rerank model in the retrieval service, outputting ranked candidates and rerank scores. "Basis entries that can be traced back to the original text" are then completed by citation trimming and answer generation. Hybrid retrieval simultaneously goes through both vector and full-text paths and merges the results; after merging, the scope is large and similarity filtering cannot be done directly, so the rerank model is usually then used to sort and filter by rerank score.
| Object | Check | Verification action |
|---|---|---|
| Product manual | Name, quantity, date, and signature must be consistent with the response scripts, and the version must be current | Take a product record from the manual, compare it with the same record in the response scripts for name, quantity, and date, and check the version number and issuance signature |
| Sales response scripts | The referenced product name, quantity, and date must be traceable back to the original manual text | Take a response entry, look back to the corresponding manual entry, and check whether the version is synchronized and whether any signature or receipt is missing |
| Channel training schedule | Course name, start date, and participating channels must match the manual and response scripts | Take a course session from the schedule, compare it with the product names and dates in the manual and response scripts, and check whether the receipt signatures are complete |
| Rerank model | Bound and used for sorting and filtering; the number of candidates and scores can be checked | Compare the order of the top three and the rerank scores before and after enabling rerank, and check the values of usingReRank, searchMode, limit, and similarity |
Three common errors
- Symptom: The same product record has inconsistent name, quantity, or date between the manual and the response scripts. Cause: The two materials are maintained separately, without cross-material field comparison and synchronization.
- Symptom: The product version referenced in the response scripts is inconsistent with the current version in the manual. Cause: After the manual was revised, the response scripts were not updated in sync, and the version number did not follow.
- Symptom: Schedule entries lack signatures or receipts, making it impossible to confirm that training was executed. Cause: The receipt collection and signature steps are not closed-loop, and material archiving is incomplete.
How to verify the setup
Acceptance for this feature: compare the order of the top three and the rerank scores before and after enabling rerank, check the number of candidates and scores, and check the values of usingReRank, searchMode, limit, and similarity.
Business test: ask a cross-material basis question, see whether the answer gives traceable sources, and check that the citation count and citation text tokens are recorded separately.
- Take the same record from the product manual, sales response scripts, and channel training schedule, compare name, quantity, date, version, and signature item by item, and mark inconsistent items.
- Run the same query once before and once after enabling rerank, compare the order of the top three and the rerank scores, confirm changes in the number of candidates and scores, and check the values of
usingReRankandsearchMode.