Test Cases and Defect Analysis for Product Usage Data Analysis: Workflow Orchestration

This category of data primarily comes from tracking systems, data warehouses, CRM systems, and ticket systems. It is synchronized in daily or weekly

What this category of data looks like

This category of data primarily comes from tracking systems, data warehouses, CRM systems, and ticket systems. It is synchronized in daily or weekly batches. Core fields include customer identifiers, function access paths, operation durations, exception trigger counts, and ticket association IDs, with units of counts, seconds, and entries. Supporting documents include usage analysis reports, tracking plans, indicator caliber tables, and dashboard requirement forms. Unified field definitions and indicator calculation rules must be maintained to ensure data alignment across teams.

What constraints do these characteristics impose on workflow orchestration

Because data sources are scattered and multiple document rules need alignment, workflow orchestration must first configure field mapping verification for multiple data sources to avoid cross-system data misalignment. The daily or weekly update rhythm requires the workflow scheduling cycle to match the data refresh window, preventing reading of dirty data that has not completed synchronization. The uniformity of indicator calibers requires the workflow to embed caliber verification nodes to pre-validate calculation logic, while also reserving branches for exception data troubleshooting to adapt to abnormal field formats from different sources. Test cases must cover process stability after data source switching or caliber changes, and defect analysis must track the flow nodes of abnormal data in the workflow.

How to set configurations

Configuration ItemRecommended ApproachRationale
variablesFixed variable set including customer ID, indicator caliber version, and data source identifierMatches indicator calibers and field definitions in supporting documents to avoid errors from dynamic value fetching during runtime
nodeIdAssign consecutive node IDs in the order of data source verification, caliber verification, and exception troubleshootingFacilitates quick location of workflow nodes when writing test cases or tracking defects
Data source verification switchEnable full field verification modeCovers field formats from tracking, CRM, and ticket systems to intercept dirty data before it enters the workflow
Scheduling cycleSet to 86400 seconds (1 day) or 604800 seconds (7 days) according to the data update rhythmMatches daily or weekly data synchronization frequencies to avoid reading incomplete datasets
Exception branch thresholdTrigger manual troubleshooting branch when abnormal data accounts for more than 5%Adapts to time requirements for daily abnormal data troubleshooting and reduces invalid workflow runs

Three common mistakes

  • Issue: In FastGPT v4.17.0, the variables configuration only displays two optional variables, and custom variables from previous versions cannot be called. Cause: The new version adjusted the registration rules for global variables. Existing variables must be re-imported via the variable configuration file in the code repository; directly reusing legacy configurations will result in missing variables.
  • Issue: When running the workflow, the prompt "Key is error. You need to use the app key rather than the account key" appears, and the workflow terminates immediately. Cause: Application keys and account keys are not distinguished, and an account-level access key was mistakenly used when configuring the data source, resulting in permission verification failure.
  • Issue: When using a specified reply node to output HTML code in the workflow, no content is displayed after execution and the workflow proceeds directly to the next branch. Cause: The specified reply node escapes output content by default, converting HTML tags to plain text. The native HTML output configuration was not enabled.

How to confirm the configuration is correct

  • Manually trigger the workflow once, check if all variables are loaded successfully, and verify that field names match the indicator caliber table.
  • Simulate input of abnormal data to confirm that the verification node corresponding to nodeId correctly identifies anomalies and triggers the corresponding branch.
  • Check the scheduling log to confirm that the workflow starts automatically according to the preset cycle, with no timeout or data read failure records.
  • Test the non-login invocation scenario to confirm that the API quota consumed by the workflow is bound to the application configuration key correctly.

The values provided are common starting points and should be measured against the reader's own samples.

Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-10-19.