[Flaky CI]: AssertionError: assert {'id': 25, 'i...d': None, ...} == {'integration...y': None, ...}

[bc-sentry]

Flakiness Type

Assertion failure

Name of Job

backend

Name of Test

tests/sentry/workflow_engine/handlers/action/notification/test_metric_alert.py::TestBaseMetricAlertHandler::test_invoke_legacy_registry

Link to Test Run

https://github.com/getsentry/sentry/actions/runs/13954892986/job/39063431349

Details

Flaky test failed hard after 5x retry.

AssertionError: assert {'id': 25, 'i...d': None, ...} == {'integration...y': None, ...}
  
  Omitting 5 identical items, use -vv to show
  Left contains 1 more item:
  {'id': 25}
  
  Full diff:
    {
  +     'id': 25,
        'integration_id': '$BIGINT',
        'sentry_app_config': None,
        'sentry_app_id': None,
        'target_display': None,
        'target_identifier': 'channel456',
    }

[getsantry]

Routing to @getsentry/product-owners-alerts for triage ⏲️

[bc-sentry]

Another flake occurred in a test in the same class

tests/sentry/workflow_engine/handlers/action/notification/test_metric_alert.py::TestOpsgenieMetricAlertHandler::test_invoke_legacy_registry

Link to Test Run
https://github.com/getsentry/sentry/actions/runs/14063833794

Details

AssertionError: assert {'group': <Gr...CAL: 20>, ...} == {'group': Non...CAL: 20>, ...}
  
  Omitting 6 identical items, use -vv to show
  Differing items:
  {'group': <Group at 0x$HEX: id=2855, project_id=$BIGINT>} != {'group': None}
  
  Full diff:
    {
  -     'group': None,
  +     'group': <Group at 0x$HEX: id=2855, project_id=$BIGINT>,
        'id': 2855,
        'metric_value': 123.45,
        'new_status': <IncidentStatus.CRITICAL: 20>,
        'open_period_identifier': 2855,
  -     'snuba_query': <SnubaQuery at 0x$HEX: id=74>,
  ?                                              ^^
  +     'snuba_query': <SnubaQuery at 0x$HEX: id=74>,
  ?                                              ^^
        'subscription': None,
    }

[bc-sentry]

Another flake occurred in a test in the same class

tests/sentry/workflow_engine/handlers/action/notification/test_metric_alert.py::TestPagerDutyMetricAlertHandler::test_invoke_legacy_registry

Link to Test Run
https://github.com/getsentry/sentry/actions/runs/13955213484

Details

AssertionError: assert {'id': 8, 'in...d': None, ...} == {'integration...y': None, ...}
  
  Omitting 5 identical items, use -vv to show
  Left contains 1 more item:
  {'id': 8}
  
  Full diff:
    {
  +     'id': 8,
        'integration_id': $BIGINT,
        'sentry_app_config': {
            'priority': 'P1',
        },
        'sentry_app_id': None,
        'target_display': None,
        'target_identifier': 'service123',
    }