Page MenuHomePhabricator

WikimediaDebugComponent
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

WikimediaDebug is a set of tools for debugging and profiling MediaWiki web requests in a production environment. WikimediaDebug can be used through the accompanying browser extension, or from the command-line. Internally, it uses the X-Wikimedia-Debug header (also known as XWD).

Use this tag for issues about:

  • browser extension, the WikimediaDebug extension for Firefox and Chromium,
  • XHGui service at https://performance.wikimedia.org/xhgui/, including its Puppet provisioning and the xhgui database in the m2 database cluster.
  • Excimer UI service at https://performance.wikimedia.org/excimer/speedscope/, including its excimer database in the m2 database cluster.
  • configuration and profiling client for the above in operations/mediawiki-config.git: (e.g. src/XWikimediaDebug, src/Profiler, and src/PhpAutoPrepend.php).

Maintained by: SRE observability Team and Release-Engineering-Team

Documentation: https://wikitech.wikimedia.org/wiki/WikimediaDebug


For tasks about daily production flame graphs, use Arc-Lamp.
For tasks about Varnish/ATS routing of the X-Wikimedia-Debug header, see Traffic.
For tasks about the mwdebug servers, see serviceops.

Recent Activity

Tue, Nov 26

Krinkle closed T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes as Resolved.
type	"sampled"
name	"https://commons.wikimedi…op=imageinfo|globalusage"
unit	"nanoseconds"
Tue, Nov 26, 7:37 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
Krinkle reassigned T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes from Krinkle to mszabo.
Tue, Nov 26, 7:36 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug

Oct 29 2024

Maintenance_bot removed a project from T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes: Patch-For-Review.
Oct 29 2024, 4:31 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
gerritbot added a comment to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes.

Change #1083921 merged by jenkins-bot:

[performance/docroot@master] bump vendor-excimer submodule checkout

https://gerrit.wikimedia.org/r/1083921

Oct 29 2024, 3:34 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug

Oct 28 2024

gerritbot added a comment to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes.

Change #1083921 had a related patch set uploaded (by Cwhite; author: Cwhite):

[performance/docroot@master] bump vendor-excimer submodule checkout

https://gerrit.wikimedia.org/r/1083921

Oct 28 2024, 10:16 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
gerritbot added a comment to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes.

Change #1081105 merged by jenkins-bot:

[performance/excimer-ui-server@master] Truncate profile name before save

https://gerrit.wikimedia.org/r/1081105

Oct 28 2024, 9:53 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug

Oct 23 2024

lmata edited projects for T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes, added: SRE Observability (FY2024/2025-Q2); removed observability.
Oct 23 2024, 2:17 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug

Oct 21 2024

gerritbot added a comment to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes.

Change #1081900 merged by Cwhite:

[operations/puppet@production] webperf: install php-mbstring

https://gerrit.wikimedia.org/r/1081900

Oct 21 2024, 10:28 PM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
gerritbot added a comment to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes.

Change #1081900 had a related patch set uploaded (by Máté Szabó; author: Máté Szabó):

[operations/puppet@production] webperf: install php-mbstring

https://gerrit.wikimedia.org/r/1081900

Oct 21 2024, 7:26 AM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug

Oct 17 2024

mszabo moved T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes from Untriaged to Oct 2024 on the Wikimedia-production-error board.
Oct 17 2024, 11:06 AM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
mszabo triaged T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes as Low priority.
Oct 17 2024, 11:04 AM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
mszabo added a project to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes: Wikimedia-production-error.
Oct 17 2024, 11:03 AM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
gerritbot added a project to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes: Patch-For-Review.
Oct 17 2024, 11:03 AM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
gerritbot added a comment to T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes.

Change #1081105 had a related patch set uploaded (by Máté Szabó; author: Máté Szabó):

[performance/excimer-ui-server@master] Truncate profile name before save

https://gerrit.wikimedia.org/r/1081105

Oct 17 2024, 11:02 AM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
mszabo created T377433: On-demand excimer profiling does not work for URLs longer than 255 bytes.
Oct 17 2024, 10:58 AM · SRE Observability (FY2024/2025-Q2), Wikimedia-production-error, WikimediaDebug
Krinkle added a hashtag to WikimediaDebug: #excimer-ui-client.
Oct 17 2024, 2:27 AM
Krinkle removed a hashtag from WikimediaDebug: #excimer-ui-client.
Oct 17 2024, 2:26 AM

Oct 1 2024

Bugreporter closed T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s as Declined.

Reopen if it is still needed.

Oct 1 2024, 3:44 PM · wikitech.wikimedia.org, WikimediaDebug, SRE

Sep 26 2024

bd808 edited projects for T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s, added: wikitech.wikimedia.org; removed Traffic.
Sep 26 2024, 8:33 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
bd808 added a comment to T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.

Interesting, good to know. This is fairly inconvenient though, especially since this is a permanent (301) redirect, meaning my browser is now confused even w/o WikimediaDebug. Can we at least use the 302 redirect in this case? Alternatively, getting a "not here" error could work as well.

Sep 26 2024, 8:30 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
Urbanecm_WMF added a comment to T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.

I don't know if there is a task for this yet, but it is known. [...]

Sep 26 2024, 8:24 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
bd808 added a comment to T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.

I don't know if there is a task for this yet, but it is known. The bug here is that we changed WikimediaDebug to support Wikitech once Wikitech is in the k8s cluster as part of T371537: MVP: Privately serve wikitech via mwdebug1001 (https://gerrit.wikimedia.org/r/c/performance/WikimediaDebug/+/1070275), but we have not yet moved Wikitech to the k8s cluster. This should be magically resolved by T292707: ☂ Migrate Wikitech to Kubernetes.

Sep 26 2024, 8:21 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
bd808 renamed T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s from With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org to With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.
Sep 26 2024, 8:20 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
Urbanecm_WMF created T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.
Sep 26 2024, 8:14 PM · wikitech.wikimedia.org, WikimediaDebug, SRE

Sep 17 2024

dancy updated the task description for T312694: Support WebExtensions Manifest v3.
Sep 17 2024, 6:39 PM · Release-Engineering-Team, Patch-For-Review, WikimediaDebug
dancy added a project to T312694: Support WebExtensions Manifest v3: Release-Engineering-Team.
Sep 17 2024, 6:25 PM · Release-Engineering-Team, Patch-For-Review, WikimediaDebug

Sep 12 2024

matmarex closed T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host as Resolved.
Sep 12 2024, 1:31 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Maintenance_bot removed a project from T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host: Patch-For-Review.
Sep 12 2024, 1:30 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Stashbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Mentioned in SAL (#wikimedia-operations) [2024-09-12T13:28:37Z] <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1072330|logging: Fix WikimediaDebug "Verbose logging" option (T374583)]] (duration: 07m 06s)

Sep 12 2024, 1:28 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Stashbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Mentioned in SAL (#wikimedia-operations) [2024-09-12T13:23:39Z] <hashar@deploy1003> matmarex, hashar: Backport for [[gerrit:1072330|logging: Fix WikimediaDebug "Verbose logging" option (T374583)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Sep 12 2024, 1:23 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Stashbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Mentioned in SAL (#wikimedia-operations) [2024-09-12T13:21:31Z] <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072330|logging: Fix WikimediaDebug "Verbose logging" option (T374583)]]

Sep 12 2024, 1:21 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
gerritbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Change #1072330 merged by jenkins-bot:

[operations/mediawiki-config@master] logging: Fix WikimediaDebug "Verbose logging" option

https://gerrit.wikimedia.org/r/1072330

Sep 12 2024, 1:21 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
hashar added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

I wonder how difficult it would be to set up Phan on that repo…

Sep 12 2024, 10:07 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
gerritbot added a project to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host: Patch-For-Review.
Sep 12 2024, 1:18 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
gerritbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Change #1072330 had a related patch set uploaded (by Bartosz Dziewoński; author: Bartosz Dziewoński):

[operations/mediawiki-config@master] logging: Fix WikimediaDebug "Verbose logging" option

https://gerrit.wikimedia.org/r/1072330

Sep 12 2024, 1:18 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
matmarex claimed T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Forgot a global $wmgUdp2logDest; in that code. A bit surprising that this didn't fail any checks. I wonder how difficult it would be to set up Phan on that repo…

Sep 12 2024, 12:58 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Krinkle moved T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host from Untriaged to Sep 2024 on the Wikimedia-production-error board.
Sep 12 2024, 12:37 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Krinkle added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Fall-out from https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1069716.

Sep 12 2024, 12:37 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Krinkle created T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.
Sep 12 2024, 12:37 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error

Jul 4 2024

Krinkle claimed T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).
Jul 4 2024, 10:26 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
andrea.denisse closed T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug) as Resolved.

Hi @Krinkle , I'll close this task as resolved because the respective patches are merged.
Feel free to reopen it if there's something else that needs to be done. Thanks!

Jul 4 2024, 9:48 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
andrea.denisse placed T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug) up for grabs.
Jul 4 2024, 9:48 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Jun 24 2024

bd808 added a comment to T367213: Integrate schedule-deployment with WikimediaDebug.

Can't extensions add CSS to pages? I have some extensions that do that. (It might require more permissions for the extension though, not sure.)
In that case, the message about adding WikimediaDebug could be given a class in the tool, and the extension could hide elements with that class.

Yes, this is generally what I meant by "I believe this would need to work by adding something to the WikimediaDebug extension that changes what is rendered on the page."

Jun 24 2024, 8:28 PM · WikimediaDebug, Tool-schedule-deployment

Jun 19 2024

jhsoby added a comment to T367213: Integrate schedule-deployment with WikimediaDebug.

I believe this would need to work by adding something to the WikimediaDebug extension that changes what is rendered on the page. There are some methods for sniffing for an installed extension in Chrome that might work, but Firefox appears to have closed those same loopholes to reduce browser fingerprinting options.

Jun 19 2024, 8:39 AM · WikimediaDebug, Tool-schedule-deployment

Jun 11 2024

bd808 added a comment to T367213: Integrate schedule-deployment with WikimediaDebug.

I believe this would need to work by adding something to the WikimediaDebug extension that changes what is rendered on the page. There are some methods for sniffing for an installed extension in Chrome that might work, but Firefox appears to have closed those same loopholes to reduce browser fingerprinting options.

Jun 11 2024, 6:02 PM · WikimediaDebug, Tool-schedule-deployment
LucasWerkmeister created T367213: Integrate schedule-deployment with WikimediaDebug.
Jun 11 2024, 5:35 PM · WikimediaDebug, Tool-schedule-deployment

Apr 26 2024

Maintenance_bot removed a project from T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug): Patch-For-Review.
Apr 26 2024, 6:04 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Apr 23 2024

gerritbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Change #925819 merged by jenkins-bot:

[performance/excimer-ui-client@master] tests: Add PHPUnit coverage

https://gerrit.wikimedia.org/r/925819

Apr 23 2024, 3:24 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Apr 3 2024

lmata added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

@Krinkle I'll ask someone to take a look then, thanks!

Apr 3 2024, 6:56 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
Krinkle added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

@lmata Code review for the main patch.

Apr 3 2024, 6:55 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug