Product listing reviews: retrieval for document comparison

Review retrieval for document comparison in Product listing reviews. Check document scope, failure paths and source evidence through controlled tests.

What the documents look like

Platform product title and detail compliance handles advertising truthfulness and qualification display. It does not handle parcel delivery, which distinguishes it from platform shipping operations. The materials handled day to day include product title tables, detail page assets, advertising prohibited-word lists, and quality inspection reports. The title table records proposed copy. Detail page assets carry images and text. The prohibited-word list names expressions that cannot be used. The quality inspection report gives physical parameters and test conclusions. The comparison task in this page checks whether parameters, qualifications, and authorization statements in titles or detail pages share the same subject, the same object, the same period, and the same field as the quality inspection report, brand authorization material, or transaction agreement.

Materials update weekly and with each new listing. Retrieval faces different versions of the same document set and wording differences for the same product across materials. The knowledge base search node can associate one or more knowledge bases that use the same vector model. Search results output quoted content as an array, and the length can be 0, so the output path proceeds even when nothing is found.

Constraints at the retrieval step

This step only performs retrieval and recall. It does not determine whether authorization holds. At operations handover, the state of materials and whether a request has been approved belong to the authorization boundary. A retrieval hit does not replace authorization confirmation. Forms collect values. Business verification, approval, database writes, and external synchronization each need a separately connected implementation.

Hypothetical paper exercise sample: an e-commerce product operator submits a title compliance check request. The material text supplied for checking reads: "Title table proposed sentence: this product has a 12-hour battery life. Quality inspection report (number ZJ-2024-031, object: Model A portable fan, inspection date March 2024, conclusion: continuous operation at room temperature for 8 hours)." The draft sentence to be judged reads: "The title says '12-hour battery life'; check whether this matches the quality inspection report." The request is pending review and has not been approved.

During retrieval, semantic search, full-text search, and hybrid search are compared separately against the test question. The citation limit uses tokens as its unit; materials of different lengths test whether content stays complete. The minimum relevance score takes effect only in semantic search or when result reranking is used. Question optimization performs coreference resolution and question expansion; the original question and the optimized question are compared to check whether the subject was altered. RRF is the fusion process for hybrid search results, not a switch. Image retrieval requires image input and model capability. Reranking requires a model and is enabled according to settings. Knowledge bases using different vector models cannot be associated together; verify the identifier first and exclude those that do not match.

Configuration and implementation checks

Configuration itemHypothetical trial starting point for this exerciseReason for the choice and comparison method
Associated knowledge basesProduct compliance base, quality inspection report baseBoth bases use the same vector model; associate only after verifying the vector model identifier matches
Search modeHybrid searchTitle parameters contain both numbers and natural language; compare semantic, full-text, and hybrid recall paths
Citation limit2000 tokens as the hypothetical trial starting pointTest with title table and quality inspection report fragments of different lengths to see whether content stays complete, then adjust
Minimum relevance score0.5 as the hypothetical trial starting pointLabel relevant and irrelevant samples first, then compare whether filtered citations cover the samples
Question optimizationEnabledCompare the original question with the optimized question, and check whether the reference "this product" was altered to a wrong subject
Result rerankingEnabledWhen a rerank model is available, enable per settings; compare rerank scores with vector scores

Three common errors

  1. Treating a retrieval hit as authorization confirmation. Input the pending-review request "the title says 12-hour battery life," compare the retrieval result with the authorization state, and observe whether pending review is treated as approved. Pending review does not show that operating permission is absent, and it is not approval.
  2. Associating knowledge bases that use different vector models. Input the product compliance base and another base with a different vector model, compare the vector model identifiers, and observe whether the non-matching base is excluded. Cross-model association is not permitted; do not run a cross-model search to compare missed recall.
  3. Treating an unstated field as a contradiction. Input the quality inspection report conclusion "continuous operation for 8 hours" and the title "12-hour battery life," compare same subject, same period, and same field, and observe whether an unstated field or evidence covering only a related stage is judged as denial or conflict. Unsupported and pending verification both preserve the evidence gap.

How to verify the setup

  1. Input the title table proposed sentence and the quality inspection report text from the hypothetical sample above, and compare whether "12-hour battery life" and "continuous operation for 8 hours" share the same subject, the same object, the same period, and the same field. A contradiction can be judged only when the field is the same and the values are mutually exclusive. When the period or object differs, record it as unsupported or pending verification.
  2. Input the draft sentence to be judged, "The title says '12-hour battery life'; check whether this matches the quality inspection report," and compare whether the quoted content returned by retrieval includes quality inspection report number ZJ-2024-031 and its conclusion. Observe whether the citation array is non-empty and points to that report. For the empty-result downstream path, a clearly stated paper input of [] can be used to check the downstream design.
  3. Input the search terms before and after question optimization, and compare whether "this product" was completed as "Model A portable fan." Observe whether the subject of the optimized question matches the original request. If the subject was altered, record it as a deviation introduced by question optimization and do not conclude on that basis that retrieval failed.

Retrieval is a recall process and does not handle permission or entity isolation. A similarity setting does not exclude unrelated businesses or unauthorized records. Unstated fields and evidence covering only a related stage are both recorded as unsupported or pending verification.