- https://meta.wikimedia.org/wiki/User:Taavi
https://meta.wikimedia.org/wiki/User:Taavi-WMF(between September 2023 and June 2024)- Profile picture: https://w.wiki/A3GY, CC BY-SA 4.0, Robert Sim
User Details
User Details
- User Since
- Feb 24 2019, 3:58 PM (279 w, 1 d)
- Roles
- Administrator
- Availability
- Busy Busy until Jul 31.
- IRC Nick
- taavi
- LDAP User
- Majavah
- MediaWiki User
- Taavi [ Global Accounts ]
Today
Today
which is tracked in T349619: Migrate roles to puppet7 and not here.
aborrero awarded T345294: Move Cloud VPS control plane alerting to alertmanager a Blobhaj token.
Fri, Jun 28
Fri, Jun 28
• taavi added a comment to T368717: Add support for locking and unlocking LDAP account to Bitu(-LDAP).
Duplicate of T359820?
• taavi updated Other Assignee for T367723: Migrate WMCS managed projects to g4 flavors, added: Andrew.
• taavi updated Other Assignee for T364457: Migrate eqiad1 hypervisors to Neutron OVS agent, added: Andrew.
• taavi awarded T279110: [infra] Replace PodSecurityPolicy in Toolforge Kubernetes a Blobhaj token.
• taavi closed T362444: Taavi knowledge transfer: maintain-kubeusers , a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi closed T362445: Taavi knowledge transfer: Toolforge k8s upgrades, a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi closed T362443: Learn how to do what Taavi does, a subtask of T335978: openstack: consider removing references to old hardware from the database, as Resolved.
• taavi closed T362447: Taavi knowledge transfer: Toolforge misc services (e.g. mail server), a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi awarded T362443: Learn how to do what Taavi does a Blobhaj token.
• taavi closed T362447: Taavi knowledge transfer: Toolforge misc services (e.g. mail server) as Resolved.
• taavi closed T362446: Taavi knowledge transfer: toolforge job investigation, a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi closed T362448: Taavi knowledge transfer: rebuild toolforge docker images, a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi closed T362449: Taavi knowledge transfer: python-flask-keystone, novaproxy, enc api as Resolved.
• taavi closed T362449: Taavi knowledge transfer: python-flask-keystone, novaproxy, enc api, a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi closed T362450: Taavi knowledge transfer: Cloud VPS OpenTofu provider, a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi closed T362452: Taavi knowledge transfer: cloud-vps monitoring, a subtask of T362443: Learn how to do what Taavi does, as Resolved.
• taavi placed T341338: eqiad1: fix PTR delegations for 185.15.56.0/24 up for grabs.
Thu, Jun 27
Thu, Jun 27
• taavi closed T311908: Migrate Toolforge Kubernetes hosts to Debian Bullseye or later, a subtask of T311897: Toolforge: migrate to Debian Bullseye or later, as Resolved.
Wed, Jun 26
Wed, Jun 26
• taavi updated the task description for T367723: Migrate WMCS managed projects to g4 flavors.
• taavi reassigned T368426: Migrate codfw1dev hypervisors to Neutron OVS agent from • taavi to Andrew.
• taavi closed T337010: cloud vps: fix flavor g3.cores16.ram32.disk20 id 37ed9aaa-35b2-4141-8bc4-272ec8bbc303 as Resolved.
Closing since this is being resolved with the new g4 flavors.
• taavi changed the subtype of T368475: Toolforge fourohfour similar name list should link directly to tools instead of toolsadmin from "Task" to "Feature Request".
which does not have a link to the webservice
• taavi added a comment to T367961: envvars-api 0.0.50 depends on unreleased envvars-cli changes.
• taavi reopened T367961: envvars-api 0.0.50 depends on unreleased envvars-cli changes as "Open".
0.0.50 (or a later version) still needs to be deployed to tools.
• taavi closed T368463: `webservice` (build 0.103.8) crashes on login-buster.toolforge.org (python 3.7) as Resolved.
The patch was merged. Given that the local hack is fixing the issue for now and the next tagged version includes the fix, I'm closing this task.
• taavi added a comment to T368439: DNS name resolution failure with cdn.esahubble.org from Cloud VPS & Toolforge.
Seemingly this works now:
taavi@tools-bastion-12:~ $ dig cdn.esahubble.org• taavi removed a project from T368439: DNS name resolution failure with cdn.esahubble.org from Cloud VPS & Toolforge: Toolforge.
Tue, Jun 25
Tue, Jun 25
Testing has been completed. There's still some cloudvirts to migrate but that's happening as a part of the real migration.
• taavi placed T144943: Groups and tools only refreshed at login up for grabs.
• taavi placed T345294: Move Cloud VPS control plane alerting to alertmanager up for grabs.
• taavi placed T367287: Update Wikitech's LDAP credentials to be read-only up for grabs.
• taavi closed T358761: Deploy OVS test setup in codfw1dev, a subtask of T326373: Migrate Cloud VPS to Neutron Open vSwitch agent, as Resolved.
• taavi placed T359217: Update Django version used in Striker up for grabs.
• taavi placed T359428: Striker should use ID instead of username to identify SUL accounts up for grabs.
• taavi placed T352886: [jobs-api,jobs-cli] php 8.2 crashes when using XMLReader up for grabs.
• taavi placed T328502: Move WMCS off of Icinga and introduce alertmanager up for grabs.
• taavi placed T288053: Add external meta-monitoring for metricsinfra up for grabs.
• taavi placed T262562: [infra] Fix the mis-named k8s service in tools and toolsbeta projects up for grabs.
• taavi updated the task description for T367723: Migrate WMCS managed projects to g4 flavors.
• taavi committed rCCKBd18dacf5a976: vps: Add a cookbook to move a floating IP address to an another server.
vps: Add a cookbook to move a floating IP address to an another server
• taavi added a comment to T368316: maintain-dbusers.service failing on cloudcontrol1005.
The relevant firewall rule is the wiki-replica-account-creation one defined in cr-labs.yaml. That would need to have an-redacteddb_group added to destination-address to allow this traffic.
Mon, Jun 24
Mon, Jun 24
• taavi edited projects for T368316: maintain-dbusers.service failing on cloudcontrol1005, added: Data-Services; removed Toolforge.
• taavi added a comment to T367415: Allow Quarry to query its own database.
OTOH exposing the list of users that have logged in to Quarry, even if they've not interacted with anything that leaves a public trace, feels a bit questionable.
kubernetes: Handle pods with no ownerReferences
• taavi updated subscribers of T368265: Disk volumes of cloud instances are completely mixed-up.
Hi, sorry for that. The servers were rebooted to pick up updated network settings: https://lists.wikimedia.org/hyperkitty/list/[email protected]/message/IYVYMGLPNOU6JON52PV6R6NKX2XHMK6R/
Sat, Jun 22
Sat, Jun 22
• taavi added a comment to T365154: video2commons general failure.
Note that Grafana graph is on your local time zone by default. The video2commons encoder instances were rebooted as a part of https://lists.wikimedia.org/hyperkitty/list/[email protected]/message/IYVYMGLPNOU6JON52PV6R6NKX2XHMK6R/ starting at 13:45 UTC, so them starting to pick up load at about 13:50 UTC matches that very closely.
Thu, Jun 20
Thu, Jun 20
• taavi added a comment to T367220: Archive the OpenStackManager extension.
Yes.
• taavi updated the task description for T364457: Migrate eqiad1 hypervisors to Neutron OVS agent.
• taavi placed T300427: Automate maintain-views replica depooling up for grabs.
• taavi updated the task description for T364457: Migrate eqiad1 hypervisors to Neutron OVS agent.
• taavi added a comment to T368007: NodeDown (cloudvirt1063).
------------------------------------------------------------------------------- Record: 27 Date/Time: 06/20/2024 02:45:43 Source: system Severity: Critical Description: CPU 2 has a thermal trip (over-temperature) event. -------------------------------------------------------------------------------
• taavi updated the task description for T364457: Migrate eqiad1 hypervisors to Neutron OVS agent.
• taavi updated the task description for T364457: Migrate eqiad1 hypervisors to Neutron OVS agent.
• taavi updated the task description for T351637: add proper dry-run/diff mode to maintain-views.
• taavi added a comment to T300427: Automate maintain-views replica depooling.
Killing existing sessions on depooled servers still doesn't work as expected. So what's left is either fixing that functionality on the HAProxy config somehow, or updating maintain-views to have the ability to kill sessions that are holding metadata locks on views that need replacing.
Wed, Jun 19
Wed, Jun 19
• taavi closed T367971: hw troubleshooting: cloudvirt1042, cloudvirt1043 fails to boot after a reimage as Resolved.
The reimages finished succesfully after a firmware upgrade.
• taavi added a comment to T367971: hw troubleshooting: cloudvirt1042, cloudvirt1043 fails to boot after a reimage.
As suggested by volans I tried running the firmware-upgrade cookbook on the other cumin server which had the correct version cached. That just finished, so I'm trying to reimage cloudvirt1042 with the 21.81 firmware release now.
• taavi added a comment to T367971: hw troubleshooting: cloudvirt1042, cloudvirt1043 fails to boot after a reimage.
cloudvirt1043 seems to be having the same issue too. So this may be an issue for the entire batch.
• taavi renamed T367971: hw troubleshooting: cloudvirt1042, cloudvirt1043 fails to boot after a reimage from hw troubleshooting: cloudvirt1042 fails to boot after a reimage to hw troubleshooting: cloudvirt1042, cloudvirt1043 fails to boot after a reimage.
• taavi edited projects for T367964: Provision more non-NFS k8s workers, added: Toolforge; removed Toolforge (Toolforge iteration 11).
• taavi added a comment to T355663: Allocate more available UNIX UIDs for human users.
Currently the highest number in use is 47058. So that's 1081 accounts in the 148 days since I created this task, or about 7.3 accounts per day. Assuming a similar rate of growth we're looking at running out of numbers in about 400 days, which would be late July next calendar year.
• taavi triaged T367961: envvars-api 0.0.50 depends on unreleased envvars-cli changes as High priority.
• taavi added a comment to T367956: haproxy: install some command line interface.
fwiw, I tend to just port-forward the stats interface on port 8404 to my laptop.