We currently have hewiki with caching enabled. It looks like our mechanism (which is the same logic we had on restbase) works as expected. Closing this for now.

Oct 28 2024, 3:21 PM · Content-Transform-Team-WIP, ChangeProp, RESTBase Sunsetting, Page Content Service

MSantos assigned T344943: Determine how PCS will be informed about resource changes in a world without RESTbase to Jgiannelos.

Oct 28 2024, 3:19 PM · Content-Transform-Team-WIP, ChangeProp, RESTBase Sunsetting, Page Content Service

MSantos moved T344943: Determine how PCS will be informed about resource changes in a world without RESTbase from Current Deploy Target to To Verify on the Content-Transform-Team-WIP board.

Oct 28 2024, 3:18 PM · Content-Transform-Team-WIP, ChangeProp, RESTBase Sunsetting, Page Content Service

Oct 25 2024

Ottomata moved T350180: Upgrade prom-client in NodeJS service-runner and enable collectDefaultMetrics from Backlog to Radar on the Event-Platform board.

Oct 25 2024, 1:25 PM · Data-Engineering, observability, ChangeProp, Event-Platform, service-runner

Oct 23 2024

bking added a comment to T360596: Figure out a plan to move forward with regarding Redis License changes.

Forgive the drive-by comment, but at the 6-month anniversary of this ticket, it might be worth checking how our upstream production applications (such as gitlab, netbox etc) are handling this change, if it all. For example, I noticed that netbox-docker is now using valkey .

Oct 23 2024, 1:34 PM · cloud-services-team, GitLab (Infrastructure), Patch-For-Review, User-aborrero, serviceops, MediaWiki-Platform-Team (Radar), collaboration-services, Release-Engineering-Team (Radar), Quarry, Toolforge, Software-Licensing, Infrastructure-Foundations, netbox, Core Platform Team Initiatives (API Gateway), ChangeProp, MediaWiki-File-management, SRE

jijiki moved T360596: Figure out a plan to move forward with regarding Redis License changes from Incoming 🐫 to 💾 Datastores on the serviceops board.

Oct 23 2024, 12:11 PM · cloud-services-team, GitLab (Infrastructure), Patch-For-Review, User-aborrero, serviceops, MediaWiki-Platform-Team (Radar), collaboration-services, Release-Engineering-Team (Radar), Quarry, Toolforge, Software-Licensing, Infrastructure-Foundations, netbox, Core Platform Team Initiatives (API Gateway), ChangeProp, MediaWiki-File-management, SRE

jijiki added a parent task for T360596: Figure out a plan to move forward with regarding Redis License changes: T325243: Evaluate out redis_misc cluster.

Oct 23 2024, 11:54 AM · cloud-services-team, GitLab (Infrastructure), Patch-For-Review, User-aborrero, serviceops, MediaWiki-Platform-Team (Radar), collaboration-services, Release-Engineering-Team (Radar), Quarry, Toolforge, Software-Licensing, Infrastructure-Foundations, netbox, Core Platform Team Initiatives (API Gateway), ChangeProp, MediaWiki-File-management, SRE

Maintenance_bot removed a project from T364779: Migrate node-based services in production to node20: Patch-For-Review.

Oct 23 2024, 11:30 AM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Mvolz updated the task description for T364779: Migrate node-based services in production to node20.

Oct 23 2024, 11:17 AM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

gerritbot added a comment to T364779: Migrate node-based services in production to node20.

Change #1082237 merged by jenkins-bot:

[operations/deployment-charts@master] Update Zotero to node 20

https://gerrit.wikimedia.org/r/1082237

Oct 23 2024, 11:02 AM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Oct 22 2024

akosiaris closed T338357: Pushing jobs to jobqueue is slow again as Resolved.

I 'll be bold and resolve this 1 year later. Feel free to reopen or alternatively make a dedicated ticket per last comment.

Oct 22 2024, 5:11 PM · ChangeProp, WMF-JobQueue

gerritbot added a project to T364779: Migrate node-based services in production to node20: Patch-For-Review.

Oct 22 2024, 3:18 PM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

gerritbot added a comment to T364779: Migrate node-based services in production to node20.

Change #1082237 had a related patch set uploaded (by Mvolz; author: Mvolz):

[operations/deployment-charts@master] Update Zotero to node 20

https://gerrit.wikimedia.org/r/1082237

Oct 22 2024, 3:18 PM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Oct 17 2024

Maintenance_bot removed a project from T364779: Migrate node-based services in production to node20: Patch-For-Review.

Oct 17 2024, 10:31 AM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

gerritbot added a comment to T364779: Migrate node-based services in production to node20.

Change #1077005 merged by jenkins-bot:

[mediawiki/services/zotero@master] Update Zotero to node 20

https://gerrit.wikimedia.org/r/1077005

Oct 17 2024, 10:17 AM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Oct 16 2024

MSantos moved T369898: Reduce the number of resource_change and resource_purge events emitted due to template changes from Needs Input (waiting) to Content Transform Team on the MediaWiki-Engineering board.

Oct 16 2024, 1:57 PM · Content-Transform-Team, Essential-Work, MW-1.43-notes (1.43.0-wmf.16; 2024-07-30), serviceops, Performance Issue, MediaWiki-Engineering, MediaWiki-Core-HTTP-Cache, ChangeProp

Oct 1 2024

gerritbot added a project to T364779: Migrate node-based services in production to node20: Patch-For-Review.

Oct 1 2024, 12:04 PM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

gerritbot added a comment to T364779: Migrate node-based services in production to node20.

Change #1077005 had a related patch set uploaded (by Mvolz; author: Mvolz):

[mediawiki/services/zotero@master] Update Zotero to node 20

https://gerrit.wikimedia.org/r/1077005

Oct 1 2024, 12:04 PM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Aug 22 2024

• ayounsi moved T360596: Figure out a plan to move forward with regarding Redis License changes from Backlog to Watching on the netbox board.

Aug 22 2024, 1:33 PM · cloud-services-team, GitLab (Infrastructure), Patch-For-Review, User-aborrero, serviceops, MediaWiki-Platform-Team (Radar), collaboration-services, Release-Engineering-Team (Radar), Quarry, Toolforge, Software-Licensing, Infrastructure-Foundations, netbox, Core Platform Team Initiatives (API Gateway), ChangeProp, MediaWiki-File-management, SRE

Aug 21 2024

kostajh closed T370502: Upgrade ipoid's NodeJS version to 20, a subtask of T364779: Migrate node-based services in production to node20, as Resolved.

Aug 21 2024, 2:33 PM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Aug 20 2024

daniel added a comment to T369898: Reduce the number of resource_change and resource_purge events emitted due to template changes.

Looking at metrics from LinksUpdate, it seems that we could reduce the number of purges a lot, if we wait until after we re-parse to decide whetehr we need to purge or not.

Aug 20 2024, 11:35 AM · Content-Transform-Team, Essential-Work, MW-1.43-notes (1.43.0-wmf.16; 2024-07-30), serviceops, Performance Issue, MediaWiki-Engineering, MediaWiki-Core-HTTP-Cache, ChangeProp

Aug 15 2024

mszabo changed the status of T370502: Upgrade ipoid's NodeJS version to 20, a subtask of T364779: Migrate node-based services in production to node20, from Open to In Progress.

Aug 15 2024, 1:16 PM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Aug 1 2024

Maintenance_bot removed a project from T367418: ChangeProp: stop making no-cache requests to parsoid endpoints in RESTBase: Patch-For-Review.

Aug 1 2024, 2:30 PM · ChangeProp, Content-Transform-Team, RESTBase Sunsetting

gerritbot added a comment to T367418: ChangeProp: stop making no-cache requests to parsoid endpoints in RESTBase.

Change #1059048 merged by jenkins-bot:

[operations/deployment-charts@master] changeprop: Add header to avoid unnecessary summary pregeneration

https://gerrit.wikimedia.org/r/1059048

Aug 1 2024, 2:04 PM · ChangeProp, Content-Transform-Team, RESTBase Sunsetting

gerritbot added a project to T367418: ChangeProp: stop making no-cache requests to parsoid endpoints in RESTBase: Patch-For-Review.

Aug 1 2024, 11:57 AM · ChangeProp, Content-Transform-Team, RESTBase Sunsetting

gerritbot added a comment to T367418: ChangeProp: stop making no-cache requests to parsoid endpoints in RESTBase.

Change #1059048 had a related patch set uploaded (by Jgiannelos; author: Jgiannelos):

[operations/deployment-charts@master] changeprop: Add header to avoid unnecessary summary pregeneration

https://gerrit.wikimedia.org/r/1059048

Aug 1 2024, 11:57 AM · ChangeProp, Content-Transform-Team, RESTBase Sunsetting

Jul 29 2024

Legoktm added a comment to T209899: The mass-message queue reports 0 when there are still queued messages.

I'm not sure what the best solution is here. The number is wrong and is probably going to be wrong going forwards. We can remove/hide it along the lines of T209899#6656593, but removing it is also an API breaking change and this seems a little trivial to trigger that.

Jul 29 2024, 3:11 PM · Data-Engineering-Icebox, Analytics-Radar, ChangeProp, WMF-JobQueue, MassMessage

Pginer-WMF closed T363968: Migrate cxserver in production to node20, a subtask of T364779: Migrate node-based services in production to node20, as Resolved.

Jul 29 2024, 8:32 AM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Jul 25 2024

KartikMistry updated the task description for T364779: Migrate node-based services in production to node20.

Jul 25 2024, 3:13 PM · Platform Engineering, Recommendation-API, Wikifeeds, Push-Notification-Service, Mobile-Content-Service, Maps (Kartotherian), EventStreams, Citoid, Proton, ChangeProp

Jul 24 2024

akosiaris added a comment to T369898: Reduce the number of resource_change and resource_purge events emitted due to template changes.

In T369898#9990749, @Ottomata wrote:

The number of resource_change and resource_purge events can get extremely high, spiking at 10k req/sec at times

I'm curious about the the problem that this causes. Too many jobs inserted for job queue to handle quickly enough? Too many purge requests at once?