Page MenuHomePhabricator

WikimediaDebugComponent
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

WikimediaDebug is a set of tools for debugging and profiling MediaWiki web requests in a production environment. WikimediaDebug can be used through the accompanying browser extension, or from the command-line. Internally, it uses the X-Wikimedia-Debug header (also known as XWD).

Use this tag for issues about:

  • browser extension, the WikimediaDebug extension for Firefox and Chromium,
  • XHGui service at https://performance.wikimedia.org/xhgui/, including its Puppet provisioning and the xhgui database in the m2 database cluster.
  • Excimer UI service at https://performance.wikimedia.org/excimer/speedscope/, including its excimer database in the m2 database cluster.
  • configuration and profiling client for the above in operations/mediawiki-config.git: (e.g. src/XWikimediaDebug, src/Profiler, and src/PhpAutoPrepend.php).

Maintained by: SRE observability Team and Release-Engineering-Team

Documentation: https://wikitech.wikimedia.org/wiki/WikimediaDebug


For tasks about daily production flame graphs, use Arc-Lamp.
For tasks about Varnish/ATS routing of the X-Wikimedia-Debug header, see Traffic.
For tasks about the mwdebug servers, see serviceops.

Recent Activity

Tue, Oct 1

Bugreporter closed T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s as Declined.

Reopen if it is still needed.

Tue, Oct 1, 3:44 PM · wikitech.wikimedia.org, WikimediaDebug, SRE

Thu, Sep 26

bd808 edited projects for T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s, added: wikitech.wikimedia.org; removed Traffic.
Thu, Sep 26, 8:33 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
bd808 added a comment to T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.

Interesting, good to know. This is fairly inconvenient though, especially since this is a permanent (301) redirect, meaning my browser is now confused even w/o WikimediaDebug. Can we at least use the 302 redirect in this case? Alternatively, getting a "not here" error could work as well.

Thu, Sep 26, 8:30 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
Urbanecm_WMF added a comment to T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.

I don't know if there is a task for this yet, but it is known. [...]

Thu, Sep 26, 8:24 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
bd808 added a comment to T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.

I don't know if there is a task for this yet, but it is known. The bug here is that we changed WikimediaDebug to support Wikitech once Wikitech is in the k8s cluster as part of T371537: MVP: Privately serve wikitech via mwdebug1001 (https://gerrit.wikimedia.org/r/c/performance/WikimediaDebug/+/1070275), but we have not yet moved Wikitech to the k8s cluster. This should be magically resolved by T292707: ☂ Migrate Wikitech to Kubernetes.

Thu, Sep 26, 8:21 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
bd808 renamed T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s from With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org to With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.
Thu, Sep 26, 8:20 PM · wikitech.wikimedia.org, WikimediaDebug, SRE
Urbanecm_WMF created T375795: With XWikimediaDebug enabled, wikitech.wikimedia.org gets redirected to foundation.wikimedia.org until Wikitech is on k8s.
Thu, Sep 26, 8:14 PM · wikitech.wikimedia.org, WikimediaDebug, SRE

Tue, Sep 17

dancy updated the task description for T312694: Support WebExtensions Manifest v3.
Tue, Sep 17, 6:39 PM · Release-Engineering-Team, Patch-For-Review, WikimediaDebug
dancy added a project to T312694: Support WebExtensions Manifest v3: Release-Engineering-Team.
Tue, Sep 17, 6:25 PM · Release-Engineering-Team, Patch-For-Review, WikimediaDebug

Thu, Sep 12

matmarex closed T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host as Resolved.
Thu, Sep 12, 1:31 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Maintenance_bot removed a project from T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host: Patch-For-Review.
Thu, Sep 12, 1:30 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Stashbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Mentioned in SAL (#wikimedia-operations) [2024-09-12T13:28:37Z] <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1072330|logging: Fix WikimediaDebug "Verbose logging" option (T374583)]] (duration: 07m 06s)

Thu, Sep 12, 1:28 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Stashbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Mentioned in SAL (#wikimedia-operations) [2024-09-12T13:23:39Z] <hashar@deploy1003> matmarex, hashar: Backport for [[gerrit:1072330|logging: Fix WikimediaDebug "Verbose logging" option (T374583)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Thu, Sep 12, 1:23 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Stashbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Mentioned in SAL (#wikimedia-operations) [2024-09-12T13:21:31Z] <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072330|logging: Fix WikimediaDebug "Verbose logging" option (T374583)]]

Thu, Sep 12, 1:21 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
gerritbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Change #1072330 merged by jenkins-bot:

[operations/mediawiki-config@master] logging: Fix WikimediaDebug "Verbose logging" option

https://gerrit.wikimedia.org/r/1072330

Thu, Sep 12, 1:21 PM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
hashar added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

I wonder how difficult it would be to set up Phan on that repo…

Thu, Sep 12, 10:07 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
gerritbot added a project to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host: Patch-For-Review.
Thu, Sep 12, 1:18 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
gerritbot added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Change #1072330 had a related patch set uploaded (by Bartosz Dziewoński; author: Bartosz Dziewoński):

[operations/mediawiki-config@master] logging: Fix WikimediaDebug "Verbose logging" option

https://gerrit.wikimedia.org/r/1072330

Thu, Sep 12, 1:18 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
matmarex claimed T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Forgot a global $wmgUdp2logDest; in that code. A bit surprising that this didn't fail any checks. I wonder how difficult it would be to set up Phan on that repo…

Thu, Sep 12, 12:58 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Krinkle moved T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host from Untriaged to Sep 2024 on the Wikimedia-production-error board.
Thu, Sep 12, 12:37 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Krinkle added a comment to T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.

Fall-out from https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1070685.

Thu, Sep 12, 12:37 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error
Krinkle created T374583: Uncaught UnexpectedValueException: Udp transport "udp:///XWikimediaDebug" must specify a host.
Thu, Sep 12, 12:37 AM · WikimediaDebug, Wikimedia-Site-requests, MediaWiki-Debug-Logger, Wikimedia-production-error

Jul 4 2024

Krinkle claimed T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).
Jul 4 2024, 10:26 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
andrea.denisse closed T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug) as Resolved.

Hi @Krinkle , I'll close this task as resolved because the respective patches are merged.
Feel free to reopen it if there's something else that needs to be done. Thanks!

Jul 4 2024, 9:48 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
andrea.denisse placed T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug) up for grabs.
Jul 4 2024, 9:48 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Jun 24 2024

bd808 added a comment to T367213: Integrate schedule-deployment with WikimediaDebug.

Can't extensions add CSS to pages? I have some extensions that do that. (It might require more permissions for the extension though, not sure.)
In that case, the message about adding WikimediaDebug could be given a class in the tool, and the extension could hide elements with that class.

Yes, this is generally what I meant by "I believe this would need to work by adding something to the WikimediaDebug extension that changes what is rendered on the page."

Jun 24 2024, 8:28 PM · WikimediaDebug, Tool-schedule-deployment

Jun 19 2024

jhsoby added a comment to T367213: Integrate schedule-deployment with WikimediaDebug.

I believe this would need to work by adding something to the WikimediaDebug extension that changes what is rendered on the page. There are some methods for sniffing for an installed extension in Chrome that might work, but Firefox appears to have closed those same loopholes to reduce browser fingerprinting options.

Jun 19 2024, 8:39 AM · WikimediaDebug, Tool-schedule-deployment

Jun 11 2024

bd808 added a comment to T367213: Integrate schedule-deployment with WikimediaDebug.

I believe this would need to work by adding something to the WikimediaDebug extension that changes what is rendered on the page. There are some methods for sniffing for an installed extension in Chrome that might work, but Firefox appears to have closed those same loopholes to reduce browser fingerprinting options.

Jun 11 2024, 6:02 PM · WikimediaDebug, Tool-schedule-deployment
LucasWerkmeister created T367213: Integrate schedule-deployment with WikimediaDebug.
Jun 11 2024, 5:35 PM · WikimediaDebug, Tool-schedule-deployment

Apr 26 2024

Maintenance_bot removed a project from T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug): Patch-For-Review.
Apr 26 2024, 6:04 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Apr 23 2024

gerritbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Change #925819 merged by jenkins-bot:

[performance/excimer-ui-client@master] tests: Add PHPUnit coverage

https://gerrit.wikimedia.org/r/925819

Apr 23 2024, 3:24 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Apr 3 2024

lmata added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

@Krinkle I'll ask someone to take a look then, thanks!

Apr 3 2024, 6:56 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
Krinkle added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

@lmata Code review for the main patch.

Apr 3 2024, 6:55 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
lmata moved T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug) from Inbox to FY2023/2024-Q4 on the SRE Observability board.
Apr 3 2024, 2:11 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
lmata added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Hola @Krinkle, is any assistance needed from our end?

Apr 3 2024, 2:11 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Mar 30 2024

gerritbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Change #1015634 merged by jenkins-bot:

[integration/config@master] jjb: Fix typo in composer-package-php81 job

https://gerrit.wikimedia.org/r/1015634

Mar 30 2024, 11:17 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
gerritbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Change #1015634 had a related patch set uploaded (by Krinkle; author: Krinkle):

[integration/config@master] jjb: Fix typo in composer-package-php81 job

https://gerrit.wikimedia.org/r/1015634

Mar 30 2024, 11:00 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
Stashbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Mentioned in SAL (#wikimedia-releng) [2024-03-30T22:02:59Z] <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1015597, T361412

Mar 30 2024, 10:03 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
gerritbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Change #1015597 merged by jenkins-bot:

[integration/config@master] jjb: Upgrade php-excimer to 1.2.1 in composer-test jobs

https://gerrit.wikimedia.org/r/1015597

Mar 30 2024, 9:58 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Mar 29 2024

gerritbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Change #1015597 had a related patch set uploaded (by Krinkle; author: Krinkle):

[integration/config@master] jjb: Upgrade php-excimer to 1.2.1 in composer-test jobs

https://gerrit.wikimedia.org/r/1015597

Mar 29 2024, 9:50 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
Krinkle added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

The above patch is a draft I wrote in June 2023. It was unable to land at the time because WMF CI installs php-excimer from deb.sury.org for most PHP versions (except the production version). And, at the time, upstream still packaged php-excimer 1.0.4, whereas support for Speedscope (which WikimediaDebug and php-ui-client build on) was added in php-excimer 1.1.0.

Mar 29 2024, 9:44 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
gerritbot added a project to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug): Patch-For-Review.
Mar 29 2024, 9:42 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
gerritbot added a comment to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).

Change #925819 had a related patch set uploaded (by Krinkle; author: Krinkle):

[performance/excimer-ui-client@master] tests: Add PHPUnit coverage

https://gerrit.wikimedia.org/r/925819

Mar 29 2024, 9:42 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
Krinkle added a project to T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug): SRE Observability.
Mar 29 2024, 9:42 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug
Krinkle created T361412: Write PHPUnit tests for excimer-ui-client (WikimediaDebug).
Mar 29 2024, 9:42 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team (Radar), WikimediaDebug

Jan 26 2024

lmata moved T347926: Excimer UI profile lost when requested from mw-on-k8s from Inbox to Done on the SRE Observability (FY2023/2024-Q2) board.
Jan 26 2024, 1:08 AM · SRE Observability (FY2023/2024-Q2), MW-on-K8s, observability, WikimediaDebug

Jan 22 2024

Jdforrester-WMF moved T343472: Make a new release of WikimediaDebug supporting wikifunctions.org from In Progress to Verify in production on the Abstract Wikipedia team board.
Jan 22 2024, 8:04 PM · MediaWiki-Platform-Team (Radar), Release-Engineering-Team, Wikifunctions, Abstract Wikipedia team, WikimediaDebug

Jan 17 2024

Maintenance_bot removed a project from T339137: Ingest php syslog from Excimer UI (webperf host) into Logstash: Patch-For-Review.
Jan 17 2024, 11:31 PM · Observability-Logging, WikimediaDebug, Performance-Team
gerritbot added a comment to T339137: Ingest php syslog from Excimer UI (webperf host) into Logstash.

Change 939285 abandoned by Cwhite:

[operations/puppet@production] logstash: move labels.trace to error.stack_trace

Reason:

no longer needed

https://gerrit.wikimedia.org/r/939285

Jan 17 2024, 10:43 PM · Observability-Logging, WikimediaDebug, Performance-Team

Oct 30 2023

pmiazga added a comment to T340573: Add support for request tracing to WikimediaDebug browser extension.

Let me move this to "Blocked/waiting" on the Platform Team Board. We need the prod/beta URL template to allow links to generated traces.

Oct 30 2023, 12:00 PM · MW-1.41-notes (1.41.0-wmf.27; 2023-09-19), MediaWiki-Platform-Team, WikimediaDebug, Observability-Tracing