Test Case and Defect Analysis for On-site Outsourced Operations Services: Tool Calling and Plugins

Data for this category typically comes from customer ITSM systems, operations monitoring platforms, asset inventory libraries, and on-duty records.

What data for this category looks like

Data for this category typically comes from customer ITSM systems, operations monitoring platforms, asset inventory libraries, and on-duty records. Daily generated documents include on-site daily reports, service desk tickets, inspection reports, and SLA monthly reports. Data update cadences are daily and monthly. On-site daily logs record details of daily on-site inspections and issue handling. Service desk tickets include issue IDs, priority levels, and response records. SLA monthly reports summarize monthly service compliance status. Most data fields are linked to on-site personnel, customer business nodes, and service time requirements.

Constraints Imposed by These Characteristics on Tool Calling and Plugins

Data for this category comes from multiple dispersed systems including customer ITSM and monitoring platforms. Document structures vary slightly based on customer needs. Tool calling must adapt to multi-source data interfaces, and handle permission and format compatibility issues across different systems. Daily updated on-site daily reports and service desk tickets require tool calling response times to match on-site processing rhythms. Monthly updated SLA reports support batch processing windows. Most document fields are linked to on-site personnel, business nodes, and service time limits. Plugins must support custom field mapping to avoid hard-coded adaptations for single customers. Data errors may impact service contracts, so tool calling must include configuration logic for failure retries and exception reporting.

How to Set Configurations

These configurations are based on FastGPT v4.17.0.

Configuration ItemRecommended SettingRationale
toolChoiceautoAdapt to multi-source data scenarios, automatically match the tool type that needs to be called currently
functionCallDynamically specified based on document typeCall corresponding parsing or analysis tools for different documents such as on-site daily reports and service desk tickets
Tool call timeout600 secondsMatch the average response duration of on-site ticket processing, avoid interrupting on-site processes due to timeouts
File parsing timeout1200 seconds, calibrated via actual testingAdapt to the parsing needs of large-volume documents such as on-site inspection reports
Custom tool variable optional configurationEnabled, with parameter range limitedAdapt to field differences across different customers, avoid passing invalid parameters
Single tool call return limitTop 3–5 entries, calibrated via actual testingFocus on core issues, reduce redundant data processing

Three Common Misconfigurations

  • Phenomenon: Excessive latency occurs when calling parsing tools for on-site tickets or inspection reports, with the interface showing processing delays beyond expected thresholds. Cause: Tool calling parameters are not adjusted for conventional document sizes, and sharding processing logic for large files is not enabled.
  • Phenomenon: No response is received when calling a specified analysis tool, and the interface does not trigger the tool call popup. Cause: The toolChoice parameter is set to auto, but no trigger conditions for the corresponding tool are associated. The system cannot automatically match and call the tool.
  • Phenomenon: The optional parameter list for custom tools does not display, or redundant content from plugin calls remains in conversation history. Cause: The optional configuration switch for custom tool variables is not enabled, and the function to filter plugin call logs from conversation history is not activated.

How to Confirm Configurations Are Correct

  • Initiate a parsing call for an on-site ticket. Check if the tool return results match the document fields, and confirm that the toolChoice or functionCall configuration takes effect.
  • Simulate a tool call timeout scenario. Verify that the system triggers retry or error reporting logic within the set duration, and confirm that the timeout configuration is correct.
  • Check conversation history. Confirm that redundant content from plugin calls has been filtered, and verify that the conversation history filtering switch is active.
  • Test parameter input for custom tools. Confirm that the optional parameter list displays normally, and verify that the variable configuration is correct.

The values listed above are common starting points, and should be evaluated against the reader's own samples.

Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-10-19.