这是indexloc提供的服务,不要输入任何密码
Skip to content

Wasm benchmark tests are flaky #9331

@elliette

Description

@elliette

Example run https://github.com/flutter/devtools/actions/runs/16356448621/job/46215950251?pr=9321

  [APP] 2025-07-17 21:47:23.428: TEST STATUS: End loading offline performance data and interacting
  Extracted 1351 measured frames.
  Skipped 95 non-measured frames.
  [APP] Client preparing to reload the window to: "http://localhost:9999?wasm=true"
  Received profile data
  Expected: empty
    Actual: '[devtools_offlineCpuProfilerScreen.wasm] flutter_frame.total_time.p90 was 23395.0 μs, which exceeded the expected threshold, 16666.6 μs.\n'
              ''
  [WASM Benchmarks] The following benchmark scores exceeded their expected thresholds:
  
  [devtools_offlineCpuProfilerScreen.wasm] flutter_frame.total_time.p90 was 23395.0 μs, which exceeded the expected threshold, 16666.6 μs.
  
  
  package:matcher                                expect
  benchmark/devtools_benchmarks_test.dart 115:3  _runBenchmarks
  Expected: empty
    Actual: '[devtools_offlineCpuProfilerScreen.wasm] flutter_frame.total_time.p90 was 19940.0 μs, which exceeded the expected threshold, 16666.6 μs.\n'
              ''
  [WASM Benchmarks] The following benchmark scores exceeded their expected thresholds:
  
  [devtools_offlineCpuProfilerScreen.wasm] flutter_frame.total_time.p90 was 19940.0 μs, which exceeded the expected threshold, 16666.6 μs.
  
  
  package:matcher                                expect
  benchmark/devtools_benchmarks_test.dart 115:3  _runBenchmarks
Shell: Starting web benchmark tests ...
Shell: Web benchmark tests finished.
Shell: Verifying devtools_navigateThroughOfflineScreens.js scores against expected thresholds.
Shell: Verifying devtools_offlineCpuProfilerScreen.js scores against expected thresholds.
Shell: Verifying devtools_offlinePerformanceScreen.js scores against expected thresholds.

Metadata

Metadata

Assignees

Labels

P2important to work on, but not at the top of the work list.dart2wasmtest flaketesting

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions