Test Cases and Defect Analysis for Database Cloud Service Operations: Tool Calling and Plugins

Core data for database cloud service operations comes from cloud database consoles, slow logs, monitoring metrics, and ticket systems. Daily generated

What data looks like for this category

Core data for database cloud service operations comes from cloud database consoles, slow logs, monitoring metrics, and ticket systems. Daily generated documents include instance change orders, backup and restore records, performance diagnosis reports, and parameter adjustment records. Data fields include instance ID, slow SQL execution time, backup file size, ticket status, and others. Units include milliseconds, GB, days, and additional units as needed. Data update frequency is daily or triggered upon instance changes. Update rhythms vary across different data sources: slow logs and monitoring metrics update in real time or near real time, while tickets and change records sync updates upon operation completion.

What constraints these characteristics impose on the tool calling and plugins workflow

Multiple data sources require tool calling to interface with multiple distinct API endpoints. Plugins must be compatible with authentication, parameter formats, and return structures of different interfaces. Differences in data update rhythms require plugin polling intervals to match the update frequency of corresponding data sources. This avoids triggering API rate limits from overly frequent polling, or data lag from overly slow polling. Specificity of document fields requires tool calling to specify extraction of particular fields, for example, returning only slow SQL execution time and execution plan. Multi-tenant service boundaries require plugins to integrate tenant permission verification logic, to prevent unauthorized access to database resources from other tenants via tool calling.

How to set configurations

These configurations apply to FastGPT v4.17.0.

Configuration ItemRecommended SettingRationale
toolChoiceSet to autoAdapt to diverse test case and defect analysis scenarios, allowing the model to autonomously select appropriate operation and maintenance tools
Tool timeout durationSet to 300-600 secondsMatch the typical response delay range of cloud database APIs, avoiding interruptions to slow SQL troubleshooting or backup restore drill workflows due to timeouts
functionCallEnable strict modeEnsure the parameter format of tool calling complies with the validation rules of cloud database APIs, reducing call failures caused by format errors
Number of items returned per tool callSet to top 10Match the batch data return limit for slow logs and monitoring metrics, avoiding context overload from excessive returned data
Tenant permission verificationEnableComply with multi-tenant boundary requirements for database cloud service operations, preventing unauthorized access to database instances from other tenants

Three common misconfigurations

  • The image URLs returned by tool calls cannot be displayed directly in the interface. This occurs because the rendering rules for tool return content are not configured, and the URL field is not marked as a renderable resource.
  • Calls to locally created MCP services fail. This occurs because the access whitelist for local services is not added in the FastGPT plugin configuration, or the service's listening port and communication protocol are not correctly configured.
  • The model does not output thought processes after enabling tool calling. This occurs because the configuration item for retaining chain-of-thought output is not enabled, or the forced tool calling mode overrides the thought process generation logic.

How to confirm configurations are correct

  • Initiate a test call for slow SQL troubleshooting. Check whether the returned results include expected fields such as instance ID and slow SQL execution time, and whether the field formats comply with the definitions of cloud database APIs.
  • View the tenant permission verification switch status in the plugin configuration. Confirm that multi-tenant isolation rules are in effect, and database instance data from other tenants cannot be accessed.
  • Trigger the tool calling workflow. Check whether the interface normally displays the resource corresponding to the returned image URL, or whether the returned text content conforms to the expected format.
  • View the tool call logs. Confirm that the timeout duration for each call falls within the configured 300-600 seconds range, and no frequent timeout errors occur.

The values provided are common starting points and should be measured against the reader's own samples.

Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-10-19.