What this category's data looks like
This page addresses anomaly tracing and manual review scenarios in academic journal business cooperation management. The core materials are three types: business cooperation agreements, advertising review forms, and distribution cooperation materials. The three material types each play different roles in the knowledge base: business cooperation agreements provide cooperation entity, term, and signature fields; advertising review forms provide advertising content, review date, and reviewer signature; distribution cooperation materials provide distribution channels, quantities, and receipt information. Materials are updated by cooperation batch and quarter, and field characteristics include name, quantity, date, signature, version number, and receipt status. During anomaly tracing, it is necessary to retrieve from the three material types whether the name, quantity, date, and signature of the same record are consistent, identify cases where versions are not synchronized or signature receipts are missing, and form an anomaly list and review conclusion supported by original records.
Configuration and implementation checks
This step is executed by the knowledge base retrieval service (retrieval node and search test), outputting candidate chunks and similarity scores (after pattern, merge, re-rank, filter, and limit trimming). The anomaly list and review conclusion are completed by subsequent nodes or manually.
| Object | Check | Verification action |
|---|---|---|
| Business cooperation agreement | Whether the name, quantity, date, and signature are consistent with the advertising review form and distribution cooperation materials | Search by agreement number in the search test, check the name, quantity, date, and signature fields in candidate chunks, and record the number of candidates and scores |
| Advertising review form | Whether the review date, reviewer signature, and receipt are synchronized with the business cooperation agreement and distribution cooperation materials | Switch searchMode to hybrid retrieval, and compare whether semantic and full-text candidates simultaneously cover the same record in the review form and the agreement |
| Distribution cooperation materials | Whether the distribution quantity, channel, date, and receipt match the business cooperation agreement and advertising review form | Compare the order of the top few candidates before and after enabling usingReRank, and confirm whether chunks related to distribution records are stably ranked at the front |
| Knowledge base retrieval service | Whether candidate chunks and similarity scores are output after pattern, merge, re-rank, filter, and limit trimming | Check the number and scores of returned candidates, adjust similarity and limit and observe candidate changes, and verify the tokens of quoted text separately |
Three common errors
- Symptom: The name or quantity of the same record does not match between the business cooperation agreement and the advertising review form. Cause: Field alignment was not performed when the two materials were entered, and although retrieval candidates hit, fields were not checked one by one.
- Symptom: The version of distribution cooperation materials is not synchronized, and the old quantity is inconsistent with the new receipt. Cause: After the materials were updated, they were not re-entered into the knowledge base, and retrieval still recalled old chunks.
- Symptom: The advertising review form lacks a reviewer signature or the distribution receipt is missing. Cause: Signature and receipt fields were not archived together with the materials, and the anomaly list lacks support from original records.
How to verify the setup
Feature acceptance: Test once each with synonym-rewritten questions, compare the number of candidates and similarity scores, then toggle re-ranking on and off to observe the order of the top few; after switching searchMode and adjusting similarity and limit, record candidate changes, and verify the tokens of quoted text separately.
Business test: Create an anomaly record, see whether the source material can be traced, and confirm that the anomaly is supported by original records and signed by the reviewer.
- In the knowledge base search test, switch
searchModeand compare whether candidate chunks under semantic, full-text, and hybrid retrieval cover the name, quantity, date, and signature fields of the same record. - Enable and disable
usingReRank, compare the order of the top few candidates, and adjustsimilarityandlimitto observe changes in the number of candidates and scores.