Page MenuHomePhabricator

Ottomata (Andrew Otto)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Saturday

  • Clear sailing ahead.

User Details

User Since
Oct 9 2014, 4:50 PM (524 w, 6 d)
Availability
Available
IRC Nick
ottomata
LDAP User
Ottomata
MediaWiki User
Ottomata [ Global Accounts ]

Recent Activity

Tue, Oct 29

Ottomata updated the task description for T331399: Create new mediawiki.page_links_change stream based on fragment/mediawiki/state/change/page.
Tue, Oct 29, 6:58 PM · Data-Engineering, Event-Platform, Machine-Learning-Team
Ottomata updated subscribers of T338792: [Event Platform] Implement PoC Event-Driven Data Pipeline for Revert Risk Model Scores using Event Platform Capabilities.
Tue, Oct 29, 6:58 PM · Data-Engineering, Epic, Wikimedia Enterprise, Machine-Learning-Team, Event-Platform
Ottomata added a comment to T370424: Streamline Data Platform access approvals for WMF staff.

Also updated docs here:
https://wikitech.wikimedia.org/w/index.php?title=SRE%2FClinic_Duty%2FAccess_requests&diff=2239783&oldid=2224064

Tue, Oct 29, 6:41 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Data-Platform-SRE, SRE
Ottomata moved T370424: Streamline Data Platform access approvals for WMF staff from In Review to Done on the Data-Engineering (Q2 2024 October 1st - December 31th) board.
Tue, Oct 29, 5:58 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Data-Platform-SRE, SRE
Ottomata added a comment to T370424: Streamline Data Platform access approvals for WMF staff.

Merged!

Tue, Oct 29, 5:58 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Data-Platform-SRE, SRE
Ottomata added a comment to T378517: Requesting access to the analytics cluster for CDobbins.

Approved

Tue, Oct 29, 5:53 PM · SRE, SRE-Access-Requests
Ottomata added a comment to T370363: Document when to use Event Platform vs Metrics Platform for instrumentation.

<3 thank you!

Tue, Oct 29, 3:37 PM · Metrics Platform
Ottomata updated subscribers of T377602: Validate that we can submit Spark jobs with Skein in Kubernetes.

Skein support in Kubernetes might not be required

Indeed!

Tue, Oct 29, 3:34 PM · Patch-For-Review, Data-Platform-SRE (2024.10.19 - 2024.11.08)
Ottomata added a comment to T377928: Ensure that we can submit spark jobs via `spark3-submit` from airflow .

we need to have the spark3-submit binary be a symlink to spark-submit, as we use it extensively in airflow-dags

Tue, Oct 29, 3:28 PM · Patch-For-Review, Data-Platform-SRE (2024.10.19 - 2024.11.08)
JAllemandou awarded T377739: [Refine Refactoring] Refine Data Quality - late events, RefineMonitor refactor, etc. a Yellow Medal token.
Tue, Oct 29, 10:46 AM · Data-Engineering (Q2 2024 October 1st - December 31th)

Mon, Oct 28

Ottomata added a comment to T376882: 2024-10-10 Data Loss Incident - webrequest Hive table .

Incident report has been moved to Wikitech.

Mon, Oct 28, 8:51 PM · Data-Platform-SRE (2024.10.19 - 2024.11.08), Movement-Insights, Data-Engineering (Q2 2024 October 1st - December 31th)
Ottomata added a comment to T373144: [SPIKE] Learn and document how to use Flink-CDC from MediaWiki MariaDB locally.

Just sent this email to the flink and paimon user email groups.

Mon, Oct 28, 4:15 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
Ottomata added a comment to T375402: Tune Dumps 2.0 hourly ingestion jobs.

how do we help the revision level MERGE INTO? The suggested partitioning schema doesn't, because we have, at an hour level about ~150k events, and at a day level it is ~3.6M

Mon, Oct 28, 3:32 PM · Patch-For-Review, Dumps 2.0 (Kanban Board)
Ottomata added a comment to T375402: Tune Dumps 2.0 hourly ingestion jobs.

@xcollazo maybe stupid idea:

Mon, Oct 28, 1:38 PM · Patch-For-Review, Dumps 2.0 (Kanban Board)
Ottomata updated subscribers of T375402: Tune Dumps 2.0 hourly ingestion jobs.
Mon, Oct 28, 1:37 PM · Patch-For-Review, Dumps 2.0 (Kanban Board)

Sat, Oct 26

Ottomata added a comment to T373144: [SPIKE] Learn and document how to use Flink-CDC from MediaWiki MariaDB locally.

I think MW will write various logs to files in ./cache, which is a mounted volume so you should be able to tail them from your host machine. Is there anything tricky in there?

Sat, Oct 26, 5:19 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
Ottomata updated the task description for T368927: [Epic] Migrate Data Platform Engineering maintained git repos to GitLab.
Sat, Oct 26, 5:15 PM · Epic, Data-Engineering
Ottomata added a comment to T373144: [SPIKE] Learn and document how to use Flink-CDC from MediaWiki MariaDB locally.

Been trying to do MariaDB -> Kafka -> Paimon with flink-cdc pipeline + Paimon sync database action, but I got stuck on the Kafka -> Paimon part. Just sent this email to the flink and paimon user email groups.

Sat, Oct 26, 3:36 AM · Data-Engineering (Q2 2024 October 1st - December 31th)

Fri, Oct 25

Ottomata added a comment to T358373: [Dumps 2] Reconciliation mechanism to detect and fetch missing/mismatched revisions.

so how would one go about "enriching" wmf_dumps.wikitext_raw_rc2 with a diff column? the job could filter the full history for only the pages changed in that hour (broadcast join) and then do the self join, but that would still require a full pass over the data which seems expensive. This certainly is solvable, e.g. one could decrease the update interval, but it is tempting to instead implement the diff as a streaming "enrichment" pipeline.

Fri, Oct 25, 6:46 PM · Patch-For-Review, Dumps 2.0 (Kanban Board)
Ottomata closed T265966: Proposal: drop kafka-php dependency from MediaWiki as Resolved.

A quick codesearch (https://codesearch.wmcloud.org/search/?q=kafka-php&files=&excludeFiles=&repos=) and local grep yields no results, so this knot might have neatly tied itself

Fri, Oct 25, 4:05 PM · Data-Engineering-Icebox, Analytics-Radar, Platform Team Workboards (Clinic Duty Team), MediaWiki-General
Ottomata added a comment to T355837: Add Prometheus support to statsd.js via mw.track().

Other use cases:

Fri, Oct 25, 4:01 PM · Patch-For-Review, Event-Platform, Data-Engineering, Grafana, MediaWiki-Platform-Team (Radar), MediaWiki-extensions-WikimediaEvents, Observability-Metrics
Ottomata added a comment to T372912: Migrate image recommendation to use page_weighted_tags_changed stream.

ACK, I see comment from David in CR.

Fri, Oct 25, 1:47 PM · Patch-For-Review, Structured-Data-Backlog, Structured Data Engineering, Data-Engineering, Discovery-Search (Current work), CirrusSearch
Ottomata updated subscribers of T376841: Render human-readable schemas on schema.wikimedia.org.

EventStreams uses OpenAPI specs and doc UI to show a human readable form. E.g. https://stream.wikimedia.org/?doc#/streams/get_v2_stream_mediawiki_page_change_v1

Fri, Oct 25, 1:47 PM · Data Products (Data Products (Data Products Sprint 21 🪂)), Documentation
Ottomata renamed T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel from Traffic for eventstreams-internal seems to be zero for the past months to Make eventstreams-internal available to WMF staff without an ssh tunnel.
Fri, Oct 25, 1:45 PM · Event-Platform, Data-Engineering, serviceops
Ottomata updated subscribers of T376841: Render human-readable schemas on schema.wikimedia.org.

This is an amazing idea thank you! We have always wanted to make schema.wikimedia.org more readable, but never had time to prioritize it. The existent UI was something I did best effort in like a day or two, so please! A replacement would be amazing.

Fri, Oct 25, 1:40 PM · Data Products (Data Products (Data Products Sprint 21 🪂)), Documentation
Ottomata added a comment to T321850: Add schema diffing support to jsonschema-tools and run diff in CI.

MR in jsonschema-tools: https://gitlab.wikimedia.org/repos/data-engineering/jsonschema-tools/-/merge_requests/51

Fri, Oct 25, 1:38 PM · Data-Engineering, Event-Platform
Ottomata merged T274901: Stop using puppet + git pull for auto deployment of schema repos into T347421: [NEEDS GROOMING] schema services should be moved to k8s.
Fri, Oct 25, 1:38 PM · Data-Platform-SRE, Event-Platform, Data-Engineering
Ottomata moved T347421: [NEEDS GROOMING] schema services should be moved to k8s from Schemas to Components on the Event-Platform board.
Fri, Oct 25, 1:38 PM · Data-Platform-SRE, Event-Platform, Data-Engineering
Ottomata moved T280017: Deploy schema repos to analytics cluster and use local uris for analytics jobs from Schemas to Components on the Event-Platform board.
Fri, Oct 25, 1:38 PM · Data-Engineering, Event-Platform, Analytics
Ottomata moved T152731: Implement server side filtering for EventStreams (if we should) from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:38 PM · Data-Engineering, Event-Platform, EventStreams
Ottomata moved T262203: Duplicated revision_create events from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:38 PM · Data-Engineering, Platform Team Workboards (Clinic Duty Team), Analytics-Radar, Event-Platform
Ottomata moved T216504: page-links-change stream is assigning template propagation events to the wrong edits from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:38 PM · Patch-Needs-Improvement, Data-Engineering, Event-Platform, Platform Team Workboards (Clinic Duty Team), The-Wikipedia-Library, Internet-Archive
Ottomata moved T263049: Avoid extra HTTPS connections for most Event Platform beacons from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:38 PM · Wikimedia-Performance-recommendation, Data-Engineering, Better Use Of Data, Product-Data-Infrastructure, Analytics, Event-Platform
Ottomata merged task T274901: Stop using puppet + git pull for auto deployment of schema repos into T347421: [NEEDS GROOMING] schema services should be moved to k8s.
Fri, Oct 25, 1:37 PM · Data-Engineering, Release-Engineering-Team (Radar), Event-Platform, Analytics
Ottomata moved T281483: mediawiki/page/properties-change schema should use map type for added and removed page properties from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:35 PM · Data-Engineering, Event-Platform, Analytics
Ottomata moved T280017: Deploy schema repos to analytics cluster and use local uris for analytics jobs from Backlog to Schemas on the Event-Platform board.
Fri, Oct 25, 1:35 PM · Data-Engineering, Event-Platform, Analytics
Ottomata moved T282057: [Event Platform] Add expiry info to mediawiki.page-restrictions-change stream from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:34 PM · Data-Engineering, Platform Team Workboards (Clinic Duty Team), Analytics, Event-Platform
Ottomata moved T173006: EventStreams (via KafkaSSE) does not consume from newly added partitions in topic from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:34 PM · Data-Engineering, Event-Platform, EventStreams
Ottomata moved T216492: Page-links-change stream doesn't capture duplicated links from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:34 PM · Data-Engineering, Data-Engineering-Radar, Event-Platform, Internet-Archive, The-Wikipedia-Library
Ottomata moved T221397: Store page-links-change data in a database table and make available through a Special page from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:34 PM · Data-Engineering, Analytics-Radar, Internet-Archive, Event-Platform, The-Wikipedia-Library
Ottomata moved T290211: EventStreams sending same data over and over (page links change) from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:33 PM · Data-Engineering, Platform Engineering, Analytics, Event-Platform
Ottomata moved T267602: Client-side error logging should use Elastic Common Schema (ECS) fields when possible from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:33 PM · Data-Engineering, Metrics Platform, Better Use Of Data, Analytics, Product-Data-Infrastructure, Event-Platform
Ottomata moved T291645: Produce ECS formatted logstash logs to Event Platform, allowing them to be queried in the WMF Data Lake with SQL from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:33 PM · Observability-Logging, Analytics, Data-Engineering, Event-Platform, Wikimedia-Logstash, SRE
Ottomata closed T292123: Introduce EventBusSendUpdate, a subtask of T292048: Queuing jobs is extremely slow, as Declined.
Fri, Oct 25, 1:33 PM · Data-Engineering, MW-1.38-notes (1.38.0-wmf.6; 2021-10-26), Analytics-Radar, Wikibase change dispatching scripts to jobs, Patch-For-Review, Event-Platform, WMF-JobQueue
Ottomata closed T292123: Introduce EventBusSendUpdate as Declined.
Fri, Oct 25, 1:33 PM · Data-Engineering, Analytics-Radar, Event-Platform
Ottomata moved T314956: [Event Platform] Declare webrequest as an Event Platform stream from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:32 PM · Patch-For-Review, Data-Engineering, Event-Platform
Ottomata moved T316112: Document and Promote Image Suggestions Feedback > Cassandra Flink Job from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:32 PM · Data-Engineering, Event-Platform
Ottomata moved T321850: Add schema diffing support to jsonschema-tools and run diff in CI from Backlog to Schemas on the Event-Platform board.
Fri, Oct 25, 1:32 PM · Data-Engineering, Event-Platform
Ottomata moved T321557: EventBus' stream config destination_event_service setting should move into producers.mediawikI_eventbus specific settings. from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:32 PM · Data-Engineering, Event-Platform, MW-1.40-notes (1.40.0-wmf.8; 2022-10-31)
Ottomata moved T321411: Add $comment and $performer to ArticleRevisionVisibilitySet params from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:32 PM · Data-Engineering, Event-Platform
Ottomata moved T328211: Support NULL values in RowData in eventutilities from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:32 PM · Data-Engineering, Event-Platform
Ottomata moved T328232: Support topics without a schema in Flink Catalog from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T329070: Automated event stream throughput alerting for important state change streams from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T324108: [SPIKE] Use Flink for batch backfilling from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T326179: Proposal: Create a stream end point for Revision Risk Model from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Event-Platform, Data-Engineering, Machine-Learning-Team, Research
Ottomata moved T329524: Refactor Image Suggestions Feedback > Cassandra Flink Job and Deploy to DSE k8s from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Image-Suggestions, Data-Engineering, Event-Platform
Ottomata moved T328565: [Flink Operations] Automate Replay of Failed Events from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T331399: Create new mediawiki.page_links_change stream based on fragment/mediawiki/state/change/page from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform, Machine-Learning-Team
Ottomata moved T333497: Include image/file changes in page-links-change from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform, EventStreams
Ottomata moved T336901: flink-app: swift bucket and zookeeper paths should be templated. from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T337491: Move eventutiltities-python repo into main wikimedia-eventutilities repository from Stream Processing to Components on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T337477: Move wikimedia-event-utilities to gitlab from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T337491: Move eventutiltities-python repo into main wikimedia-eventutilities repository from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Data-Engineering, Event-Platform
Ottomata moved T338380: eventutilities-python: http event process function should report latency. from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:31 PM · Event-Platform, Data-Engineering
Ottomata moved T331283: [Event Platform] [NEEDS GROOMING] Store Flink HA metadata in Zookeeper from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:30 PM · Discovery-Search, Event-Platform, serviceops-radar, Data-Engineering
Ottomata moved T340195: mediawiki-event-enrichment: changes to test image seem to be ignored in CI from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:30 PM · Event-Platform, Data-Engineering
Ottomata moved T341138: mediawiki-event-enrichment deployment process should include producing an event in staging and verifying success from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:30 PM · Data-Engineering, Event-Platform
Ottomata moved T345389: [SPIKE] Should we introduce static typing to Event Platform nodejs codebases? from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:30 PM · Event-Platform, Data-Engineering
Ottomata moved T345606: [Event Platform] Event streams don't respect milliseconds UTC unix epoch timestamp in since parameter from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:30 PM · Data-Engineering, EventStreams, Event-Platform
Ottomata moved T345914: [Event Platform] Define Flink k8s operator SLO from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:30 PM · Data-Engineering, Data-Platform-SRE, Event-Platform
Ottomata moved T346207: [TEMPLATE] Onboard request for APPLICATION NAME to Event Platform from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:30 PM · Event-Platform, Data-Engineering
Ottomata moved T347282: [Event Platform] eventutilites-python: improve consistency guarantees of async process functions from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:29 PM · Data-Engineering, Event-Platform
Ottomata moved T259712: Allow disabling/enabling configured streams via wgEventStreams config from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:29 PM · Event-Platform, MW-1.40-notes (1.40.0-wmf.8; 2022-10-31), Data-Engineering, Better Use Of Data, Product-Data-Infrastructure, Core Platform Team Initiatives (Modern Event Platform (TEC2))
Ottomata moved T351411: Undelete of page with same title leads to unexpected results from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:29 PM · MediaWiki-Page-deletion, MediaWiki-Platform-Team (Radar), Data-Engineering, Event-Platform
Ottomata moved T355837: Add Prometheus support to statsd.js via mw.track() from Stream Data Products to Components on the Event-Platform board.
Fri, Oct 25, 1:29 PM · Patch-For-Review, Event-Platform, Data-Engineering, Grafana, MediaWiki-Platform-Team (Radar), MediaWiki-extensions-WikimediaEvents, Observability-Metrics
Ottomata moved T364166: Add isp_data to event_transforms refine from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:29 PM · probenet, Event-Platform, Data-Engineering
Ottomata moved T256891: EventGate and EventStreams rate limiting from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:29 PM · Data-Engineering, Event-Platform, Analytics
Ottomata moved T370524: Simplify EventBus code by deprecating EventBusFactory from Backlog to Components on the Event-Platform board.
Fri, Oct 25, 1:28 PM · Data-Engineering, Event-Platform
Ottomata moved T373689: EventStreams: kafka key should be serialized as a string from Stream Data Products to Components on the Event-Platform board.
Fri, Oct 25, 1:28 PM · Data-Engineering, Event-Platform, EventStreams
Ottomata closed T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel as Declined.

@BTullis do you think it would be possible to add authentication and a public domain to this service? I think Metrics Platform folks would really like this. cc @mpopov @phuedx (This would allow you to use a stream.wikimedia.org UI but for all internal event streams).

Fri, Oct 25, 1:28 PM · Event-Platform, Data-Engineering, serviceops
Ottomata moved T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel from Stream Data Products to Components on the Event-Platform board.
Fri, Oct 25, 1:28 PM · Event-Platform, Data-Engineering, serviceops
Ottomata moved T353650: EventStreams should deserialize Kafka key from Stream Data Products to Components on the Event-Platform board.
Fri, Oct 25, 1:28 PM · Data-Engineering, Event-Platform, EventStreams
Ottomata moved T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:27 PM · Event-Platform, Data-Engineering, serviceops
Ottomata reopened T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel as "Open".
Fri, Oct 25, 1:27 PM · Event-Platform, Data-Engineering, serviceops
Ottomata updated subscribers of T348763: Make eventstreams-internal available to WMF staff without an ssh tunnel.
Fri, Oct 25, 1:27 PM · Event-Platform, Data-Engineering, serviceops
Ottomata moved T350180: Upgrade prom-client in NodeJS service-runner and enable collectDefaultMetrics from Backlog to Radar on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Data-Engineering, observability, ChangeProp, Event-Platform, service-runner
Ottomata moved T354577: Create Mediawiki "oversightprotect" action that suppresses usernames of all edits of a page from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Trust and Safety Product Team, Wikimedia-Hackathon-2024, MediaWiki-Revision-deletion, MediaWiki-Page-protection, User-DannyS712, Privacy Engineering, Data-Engineering, Security, Event-Platform, EventStreams
Ottomata moved T353650: EventStreams should deserialize Kafka key from Stream Processing to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Data-Engineering, Event-Platform, EventStreams
Ottomata moved T351565: Implement a new notification only revision-visibility-change stream from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Data-Engineering, Event-Platform
Ottomata moved T353650: EventStreams should deserialize Kafka key from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Data-Engineering, Event-Platform, EventStreams
Ottomata moved T355837: Add Prometheus support to statsd.js via mw.track() from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Patch-For-Review, Event-Platform, Data-Engineering, Grafana, MediaWiki-Platform-Team (Radar), MediaWiki-extensions-WikimediaEvents, Observability-Metrics
Ottomata moved T360794: Implement stream of HTML content on mw.page_change event from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Data-Engineering, Event-Platform
Ottomata moved T361094: Orchestrate gobblin ingestion task with Airflow and config store. from Backlog to Radar on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Event-Platform, Data-Engineering
Ottomata moved T351225: [Research Engineering Request] Productionized Edit Types from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:25 PM · Data-Engineering, Event-Platform, Research-Freezer, Research-engineering
Ottomata moved T351089: Utilize Kafka Headers from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:24 PM · Event-Platform, Data-Engineering
Ottomata moved T368678: Deprecate use of desktop- and mobilewebuiactions in Event Platform from Backlog to Radar on the Event-Platform board.
Fri, Oct 25, 1:24 PM · Web-Team-Backlog (FY2024-25 Q2 Sprint 2), Web Team Essential Work 2024 (Migrate to new Event Platform), Data-Engineering, Event-Platform
Ottomata moved T373195: Migrate Search Platform-owned helm charts to Calico Network Policies from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:24 PM · Data-Platform-SRE (2024.10.19 - 2024.11.08), Data-Engineering, Event-Platform, Patch-For-Review, Prod-Kubernetes, Kubernetes, serviceops
Ottomata moved T371305: Update code comment links to Meta-Wiki schemas to new event platform from Backlog to Schemas on the Event-Platform board.
Fri, Oct 25, 1:24 PM · Documentation, Data-Engineering, Event-Platform, MediaWiki-extensions-General
Ottomata moved T373112: [NEEDS INVESTIGATION][BUG] eventutilities_python operator metrics from Backlog to Stream Processing on the Event-Platform board.
Fri, Oct 25, 1:24 PM · Dumps 2.0, Data-Platform, Data-Engineering, Event-Platform
Ottomata moved T373644: Provide data on whether the file itself was changed in mediawiki.page_change.v1 event from Backlog to Stream Data Products on the Event-Platform board.
Fri, Oct 25, 1:24 PM · Data-Engineering, Event-Platform, Wikimedia Enterprise Engineering, Wikimedia Enterprise