What the documents look like
Commission settlement for creator partnerships happens after a sale closes. The review focus sits on valid promotion and post-sale commission deductions rather than on the live promotion itself. When procurement and supplier records enter this step, the materials typically include commission setting records, settlement statements, refund deduction details, and invoices. These materials are maintained by different roles. Finance settlement reviews amounts and posting, the alliance operations role reviews orders and refunds, and the creator business role reviews contracts and settlement terms. Material updates occur weekly or monthly. Citation tracing must answer a narrow question: for a given settlement or deduction conclusion, which material, which version, and which passage is being cited.
Constraints at the citation tracing step
The knowledge base search node can associate one or more knowledge bases that share the same vector model, used for vector search. The output is an array of cited content, and its length may be zero. Even when nothing is retrieved, this output path still runs through. The citation limit is controlled by tokens. The minimum relevance value takes effect only under semantic retrieval or when result reranking is used. Hybrid retrieval merges multiple result paths through RRF, and reranking requires an available model and must be enabled by configuration. These conditions mean retrieval results are candidate sources only. Whether a citation is adopted still requires review against the valid version. Retrieval does not perform authorization judgment, and similarity does not constitute a permission or entity filter.
Hypothetical drill sample: the source material reads, "The March 2024 settlement statement records that for creator A, valid order commission for the period March 1 to March 15 is 12,000 yuan; the refund deduction details for the same period record commission corresponding to refunded orders as 1,500 yuan; the commission setting record states that the applicable commission rate for this period is 10 percent." The draft sentence to be assessed is: "Creator A's payable commission for the period March 1 to March 15 is 12,000 yuan, and the refund deduction has been handled separately." This draft sentence does not state whether the refund deduction is subtracted from the payable amount, and it does not cite the invoice or the settlement terms in the contract.
Configuration and implementation checks
| Configuration or check item | Hypothetical starting point for this trial | Reason for the choice and comparison method |
|---|---|---|
| Associated knowledge bases | Select the three bases: settlement statement, refund deduction details, commission setting record | The vector model identifiers of the three must match before they can be associated together; check identifiers one by one and exclude any that do not match |
| Citation limit | Set to 3,000 tokens | Hypothetical starting point for this trial, intended to hold several passages of statement text; compare with 1,500 tokens and observe whether key fields are truncated |
| Minimum relevance | Set to 0.3 | Hypothetical starting point for this trial, effective only under semantic retrieval or reranking; compare with 0.5 and observe citation count and source coverage |
| Search mode | Hybrid retrieval | Statements contain dates and amounts, and identifier-like fields suit full-text recall, while semantic recall supplements wording differences |
| Result reranking | Enabled, using a ReRank model | Second-pass ordering when candidates are numerous; compare with not enabling it and observe whether citation order aligns more closely with the question |
| Citation handoff | Pass the citation array to the answering step for item-by-item review | An empty array is handled as zero length and is not treated as a workflow error termination |
Three common errors
- Treating a retrieval hit as authorization or settlement confirmation. The input is the draft sentence and the retrieved statement passage; the comparison is between the retrieval result and the authorization boundary. The observable result is that retrieval returned the statement text, yet the draft sentence still lacks a statement on whether the refund deduction is subtracted, so settlement cannot be treated as completed on this basis.
- Forcing knowledge bases with different vector models into a joint association. The input is the model identifiers of the three bases; the comparison is whether the identifiers match. The observable result is that when identifiers do not match, joint association is not possible, and the only step is to exclude those that do not match and record the actual observation, without inferring missed recall or redundancy.
- Treating minimum relevance as an entity or permission filter. The input is the minimum relevance setting and an unrelated business query; the comparison is between returned content and the query subject. The observable result is that low-similarity content may be filtered, but a similarity setting does not exclude unauthorized records, and authorization still requires separate review.
How to verify the setup
- For the hypothetical sample, input the three source sentences and the draft sentence, and compare whether the draft sentence states the deduction relationship of the refund deduction. The observable result is that the draft sentence does not state this relationship, so it is judged unsupported and must be supplemented with the deduction field in the refund deduction details or the contract terms.
- For the model identifiers of the three knowledge bases, input the identifier list and compare whether they match. The observable result is that joint association is possible only when they match; when they do not match, exclude those that do not match and do not run cross-model retrieval to compare missed recall.
- For the citation output, input a query that may return an empty array, and compare whether the downstream answering step handles it as zero length. The observable result is that an empty array runs through the output path without triggering a fabricated error or an automatic business action; whether a citation is adopted still requires review against the valid version.