Test Cases and Defect Analysis for Version Releases and Release Notes: Citation Sources and Traceability

Core data for this category comes from Git repository tags, merged commit records, artifact packages generated by CI pipelines, and associated Issue

What Data for This Category Looks Like

Core data for this category comes from Git repository tags, merged commit records, artifact packages generated by CI pipelines, and associated Issue milestones. Daily output documents include release notes, change logs, version tag files, and pre-release checklists. Data updates occur once per official version release. Each single update includes all merged change entries, associated defect records, and artifact verification information for that version. Document structure centers on the version number as the core identifier, with additional fields for change classification, breaking change notes, and associated resource links. Overall content adjusts dynamically based on the scale of the version release.

Constraints Imposed on Citation Sources and Traceability

The binding relationship between Git tags and merge records requires the traceability link to accurately match the association between commit hashes and version tags. This prevents cross-version confusion of change content. Hash verification fields for CI artifacts require the traceability link to directly link to the integrity information of the artifact package. Text-only fields cannot complete this verification. The number of change log entries fluctuates with version scale. The system must adapt to context citations of varying lengths, and avoid truncating critical information due to length limits. The timeliness of version releases requires traceability results to strictly align with the release time of the current version. It must not cite change content not included in that version. Community-facing releases require traceability information to be publicly verifiable. Access paths and verification basis for original data must be retained.

How to Configure Settings

The following configurations are based on the interface logic of FastGPT v4.17.0.

Configuration ItemRecommended SettingRationale
Maximum Citation Token Count6000–10000 tokenAdapts to the total text volume of a single-version Release Notes, ensuring complete citation of change and defect association information
Returned Data Source ScopeOnly include Git tags, merge records, CI artifacts, and Issue milestonesAccurately matches the core data sources for this category, filtering out irrelevant non-version-associated content
Detail Display ToggleEnabledRetains the full context of original change records, making it easier to trace specific modification content during test case and defect analysis
Context Recall CountTop 3–5 entriesMatches the number of change entries for a single version, avoiding redundant citations that interfere with analysis
Citation Format AdaptationCalibrated based on actual testingAdapts to the Markdown format of Release Notes, ensuring cited content renders correctly

Three Common Misconfigurations

  • Phenomenon: Cited Release Notes content fails to render Markdown format properly. Only raw ##, -, and other markup symbols are displayed. Cause: No citation rendering rules configured for this category’s document format. The default rendering logic does not recognize the change entry format in Release Notes.
  • Phenomenon: Change records for some versions cannot be successfully traced and cited. Empty citation results are returned. Cause: Data source scope is not correctly restricted. Core version-associated data such as Git tags and CI artifacts are not included in the recall pool.
  • Phenomenon: Cited context includes change content from non-current versions. Cause: Context recall count is set too high. The system does not restrict recall to only associated data from the currently specified version.

How to Verify Proper Configuration

  • Upload a single-version Release Notes document, initiate a test case generation request, and verify that returned citation content includes core fields such as version tags and CI artifact hashes.
  • View the citation display area, confirm that Markdown-formatted change entries render correctly into readable lists and headings.
  • Adjust the context recall count, validate that the number of returned citation entries matches the set range.
  • Simulate a cross-version query request, confirm that only associated data from the currently specified version is returned. No content from other versions is included.

The values provided here are common starting points. They should be evaluated against the reader’s own samples.

Question material comes from public community discussions. Configuration values are common starting points and should be measured against your own samples. Verified on 2026-10-19.