What this type of data looks like
Data sources for IT service desk ticket processing include enterprise ITSM systems, phone or online chat logs, asset systems, and internal knowledge bases. Data update frequency is daily or real-time, covering daily service requests, incident tickets, processing records, and user satisfaction forms. Each data entry includes fields such as ticket number, submitting user ID, problem description, fault phenomenon, troubleshooting steps, handler, response duration, resolution result, and satisfaction score. Some data is associated with asset numbers and department information.
What constraints do these characteristics impose on the reranking and hybrid retrieval workflow
Multi-source heterogeneous data structures require hybrid retrieval to adapt to both structured ticket numbers and unstructured fault descriptions, while balancing the accuracy of keyword matching and semantic retrieval. Real-time or daily update frequency requires the retrieval pipeline to have low latency, to avoid result deviations caused by delayed index updates. Ticket fields cover multi-dimensional information such as problem classification and processing records. The reranking link must prioritize matching core semantic fields, to avoid irrelevant results interfering with ticket assignment and troubleshooting workflows. At the same time, the time sensitivity requirements of service desks limit the total time spent on retrieval and reranking, requiring a balance between the number of recalled results and processing speed.
Configuration Settings
| Configuration Item | Recommended Setting | Rationale |
|---|---|---|
similarity | 0.72–0.80 | Matches fault descriptions and problem classifications of tickets, filters low-relevance historical tickets and invalid results |
limit | Top 10 entries | Controls the number of returned candidate results, adapts to the time sensitivity requirements of fast service desk responses |
searchMode | hybrid | Integrates vector retrieval and keyword retrieval, balances matching accuracy for structured ticket numbers and unstructured fault descriptions |
usingReRank | Enabled | Performs semantic reranking on candidate results, corrects semantic deviations that may occur in vector retrieval, and improves the rationality of result ranking |
| Reranking model call timeout | 8 seconds | Adapts to the overall response time of the service desk, avoids ticket processing delays caused by reranking model timeouts |
Three common misconfigurations
- Symptom: Hybrid retrieval call duration exceeds 10 seconds, with vector retrieval taking approximately 8 seconds per call. Cause: The number of candidate inputs for the reranking model is not limited, causing the reranking model to process an overly large result pool and extending the total call duration.
- Symptom: GPU memory usage grows rapidly to 6–7 GB after calling the reranking model, with multiple GPUs occupied simultaneously. Cause: The concurrent call limit for the reranking model is not configured, causing multiple retrieval tasks to load model instances at the same time and leading to excessive occupation of video memory resources.
- Symptom:
rerank erroris returned when connecting to the reranking model, and the error message contains an emptydetailfield. Cause: No fault-tolerant logic is configured for the reranking model results. When the model returns empty results or abnormal formatting, no fallback processing is performed, triggering an error.
How to confirm the configuration is correctly applied
- Log in to the FastGPT v4.17.0 management backend, view the retrieval task logs, and confirm that
searchModeis set to hybrid andusingReRankis enabled. - Submit a standard IT service ticket for simulation, and verify that the number of returned candidate results matches the
limitsetting. - Adjust the
similaritythreshold, test the filtering effect of retrieval results, and confirm that low-relevance tickets are not included in the candidate pool. - View the GPU monitoring panel, confirm that the memory usage of the reranking model remains within a reasonable range, with no abnormal growth or simultaneous repeated occupation by multiple GPUs.
The values provided are common starting points and should be measured against the reader's own samples.
Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-10-19.