Page MenuHomePhabricator
Create Task
Maniphest T187154

Performance regression from Apcu/ExtensionRegistry::loadFromQueue on PHP7
Closed, ResolvedPublic
Actions

Description

In reviewing gerrit change 409498, I noticed code for wgExtensionInfoMTime, which is an optimisation to avoid run-time overhead for checking mtimes on all extension.json files.

It seems this optimisation isn't enabled in production. If we don't need it, we should consider removing it (or adding tests for it). Alternatively, if we do need it, we should figure out how we want to enable it, and what it means for our deployment workflow.

Status

Details

SubjectRepoBranchLines +/-
ExtensionRegistry: Remove exporting and caching of wgExtensionCreditsmediawiki/coremaster+62 -24
SpecialVersion: Consolidate internal use of wgExtensionCreditsmediawiki/coremaster+32 -34
Move checking code to a new namespacemediawiki/extensions/Mathmaster+46 -22
Move one class to AutoloadNamespacesmediawiki/extensions/Echomaster+3 -1
Namespace-ification!mediawiki/extensions/SecurePollmaster+883 -516
Use AutoloadNamespaces for maintenance scriptsmediawiki/extensions/CirrusSearchmaster+42 -12
Move some classes to AutoloadNamespacesmediawiki/extensions/CirrusSearchmaster+42 -46
Namespace EventBus extensionmediawiki/extensions/EventBusmaster+146 -51
Move some classes to AutoloadNamespacesmediawiki/extensions/MobileFrontendmaster+1 -2
Move some classes to AutoloadNamespacesmediawiki/extensions/Babelmaster+4 -7
Move some more classes to AutoloadNamespacesmediawiki/skins/MinervaNeuemaster+3 -7
Fixup namespacing in MassMessagemediawiki/extensions/MassMessagemaster+72 -60
Fix namespacing for rest of the classesmediawiki/extensions/LocalisationUpdatemaster+21 -25
Namespace LocalisationUpdate classmediawiki/extensions/LocalisationUpdatemaster+13 -4
Move some classes to AutoloadNamespacesmediawiki/extensions/MassMessagemaster+3 -11
Move some more classes to AutoloadNamespacesmediawiki/skins/Vectormaster+1 -4
Move some classes to AutoloadNamespacesmediawiki/extensions/WikimediaEventsmaster+5 -4
Move some classes to AutoloadNamespacesmediawiki/extensions/Collectionmaster+3 -8
Move some classes to AutoloadNamespacesmediawiki/extensions/PageImagesmaster+5 -5
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/PageAssessmentsmaster+4 -10
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/GettingStartedmaster+4 -14
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/InterwikiSortingmaster+3 -5
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/TemplateWizardmaster+3 -3
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/ExternalGuidancemaster+2 -3
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/JsonConfigmaster+2 -23
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/FileExportermaster+3 -3
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/GlobalUserPagemaster+2 -7
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/SiteMatrixmaster+3 -12
Swap AutoloadClasses for AutoloadNamespacesmediawiki/extensions/Graphmaster+2 -6
Move most Flow files to AutoloadNamespacesmediawiki/extensions/Flowmaster+3 -317
Remove duplication of extension.json from TocTree (require MW 1.32+)mediawiki/extensions/TocTreemaster+15 -50
registration: Move 'TrackingCategories' to lazy-loaded attributemediawiki/coremaster+1 -0
registration: Avoid redundant LBYL check in ExtensionRegistry::queue()mediawiki/coremaster+6 -7
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Krinkle added a comment.EditedMar 9 2020, 6:53 PM

Keys, sub keys, and attributes from extensions.json files in WMF production, listed by frequency (see T187154#5900039):

  • url
  • name (required for ExtensionRegistry->isLoaded)
  • MessagesDirs
  • manifest_version (hard-required)
  • descriptionmsg
  • license-name
  • author, author.0, author.1
  • type
  • Hooks, Hooks.* (required for wgHooks/Setup.php)
  • requires, requires.* (hard-required)
  • config (keep)
  • AutoloadClasses, AutoloadNamespaces (required for Setup.php)
  • version
  • ResourceModules, ResourceFileModulePaths – See T247265
  • ExtensionMessagesFiles
  • SpecialPages
  • APIModules
  • AvailableRights
  • GroupPermissions
  • ConfigRegistry
  • DefaultUserOptions
  • callback (required for Setup.php)
  • JobClasses
  • TestAutoloadClasses – See T240535
  • load_composer_autoloader (required for Setup.php)
  • LogActionsHandlers
  • attributes
  • APIListModules
  • LogTypes
  • ServiceWiringFiles (required for Setup.php)
  • TrackingCategories (Done) Lazy as of https://gerrit.wikimedia.org/r/559650/
Krinkle mentioned this in T247265: Export extension.json "ResourceModules" as attribute instead of config.Mar 9 2020, 8:26 PM
Krinkle removed projects: MW-1.35-notes (1.35.0-wmf.20; 2020-02-18), Patch-For-Review.Mar 16 2020, 3:03 AM
Krinkle moved this task from Doing (old) to Blocked (old) on the Performance-Team board.Mar 16 2020, 8:51 PM
Krinkle added a subtask: T236800: Ensure apcu incr/decr are atomic (Upgrade php-apcu).Mar 20 2020, 8:36 PM
Krinkle closed subtask T247265: Export extension.json "ResourceModules" as attribute instead of config as Resolved.Apr 2 2020, 2:20 AM
Krinkle added a comment.Apr 4 2020, 3:16 AM

With T247265 and various others above fixed and deployed, time to take another look:

In T233886#5532734, @Krinkle wrote:

For load.php (2019-09-29 samples):

  • 38.25% is spent within WebStart.php:
    • 17.28% in ExtensionRegistry::loadFromQueue.
    • 2.63% in MediaWikiServices::getDBLoadBalancer. – T228895

For api.php (2019-09-29 samples):

  • 24.67% is spent within WebStart.php:
    • 9.58% in ExtensionRegistry::loadFromQueue.
    • 1.46% in MediaWikiServices::getDBLoadBalancer.
    • 3.99% in SessionManager::getGlobalSession.

For index.php (2019-09-29 samples):

  • 13.19% is spent within WebStart.php:
    • 5.07% in ExtensionRegistry::loadFromQueue.
    • 0.72% in MediaWikiServices::getDBLoadBalancer.
    • 1.97% in SessionManager::getGlobalSession.

For load.php (2020-04-04):

  • 24.28% is spent within WebStart.php:
    • 11.45% in ExtensionRegistry::loadFromQueue .
    • 3.21% in MediaWikiServices::getDBLoadBalancer.

For api.php (2020-04-04):

  • 26.31% is spent within WebStart.php:
    • 9.84% in ExtensionRegistry::loadFromQueue .
    • 2.20% in MediaWikiServices::getDBLoadBalancer.
    • 3.99% in SessionManager::getGlobalSession.

For index.php (2020-04-04):

  • 12.98% is spent within WebStart.php:
    • 5.07% in ExtensionRegistry::loadFromQueue .
    • 1.08% in MediaWikiServices::getDBLoadBalancer.
    • 1.44% in SessionManager::getGlobalSession.
Krinkle added a comment.EditedApr 6 2020, 10:24 PM
In T187154#5954675, @Krinkle wrote:

Keys, sub keys, and attributes from extensions.json files in WMF production, listed by frequency (see T187154#5900039):

  • …
  • …

I dumped enwiki's "main" ExtensionRegistry cache value from APCu (from mwdebug1001, after a warmup).

You can browse it on deploy1001.eqiad.wmnet:/home/krinkle/enwiki-T187154-extregistry-main-apcu.json.

It is about 894K in size (as minified JSON).

In JSON pretty-print it is 29,204 lines of code, which I've used as a rough way to measure which keys take up the most space:

line of pretty json | keys

2231 wgExtensionCredits
1748 credits
1593 wgHooks
1018 wgAutoloadClasses
461 wgMessagesDirs
443 wgEcho*/wgDefaultNotify*/wgNotifyType*
329 wgCirrusSearch*
151 wgPageTriageTagsOptionsMessages
124 wgCentralNoticeCampaignMixins
111 wgLinterCategories
97 wgRawHtmlMessages
96 wgGroupPermissions
91 wgSpecialPages
79 wgAPIModules
71 wgExtensionMessagesFiles
64 wgMwEmbedModuleConfig
60 wgGrantPermissions
60 wgPageTriageDeletionTagsOptionsMessages
50 wgDefaultUserOptions

Of special note:

  • The vast majority of the blob is the default configurations from all extensions (as read from extension.json).
  • Much of the default configuration is stored twice, not sure why. Once as wg-key, and a second time in more verbose form under config. Presumably we only read one of them at run-time so we probably shouldn't store the unprocessed form. Might be as easy as an unset() somewhere.
  • The pattern "providedby": "…" is repeated nearly a thousand times through the verbose config format, but does not appear to be used for anything.
Krinkle mentioned this in T249564: Determine purpose of GlobalVarConfig-backend entries in ConfigFactory (via wgConfigRegistry).Apr 6 2020, 10:43 PM
Krinkle added a comment.Apr 8 2020, 4:53 PM

By far the biggest is 2231 wgExtensionCredits, 1748 credits. I'll try to tackle this one next. It's both something we presumably only need on Special:Version (where it can be fetched and cached as its own cache key), and also an interesting case of the same values being stored twice, which I haven't quite figured out why yet either.

Anomie added a comment.Apr 8 2020, 7:50 PM
In T187154#6040641, @Krinkle wrote:

It's both something we presumably only need on Special:Version (where it can be fetched and cached as its own cache key),

Looks like it's also read in ApiQuerySiteInfo (for output) and ApiBase (for mapping files to source extensions for the auto-generated help).

I see a lot of references to $wgExtensionCredits in extensions, most of which appear to be writing entries instead of using extension.json but a few are doing other things. Among Wikimedia-deployed extensions, I see only two:

None of that argues against it being lazy-loaded, IMO.

and also an interesting case of the same values being stored twice, which I haven't quite figured out why yet either.

Looks like ->credits came first, then T108269: $wgExtensionCredits handling in ExtensionProcessor/ExtensionRegistry is weird duplicated it into ->globals.

gerritbot added a comment.Apr 8 2020, 11:12 PM

Change 587609 had a related patch set uploaded (by Krinkle; owner: Krinkle):
[mediawiki/extensions/TocTree@master] Remove duplication of extension.json from TocTree (require MW 1.32+)

https://gerrit.wikimedia.org/r/587609

gerritbot added a project: Patch-For-Review.Apr 8 2020, 11:12 PM
gerritbot added a comment.Apr 9 2020, 3:07 AM

Change 587609 merged by jenkins-bot:
[mediawiki/extensions/TocTree@master] Remove duplication of extension.json from TocTree (require MW 1.32+)

https://gerrit.wikimedia.org/r/587609

Legoktm added a comment.Apr 9 2020, 3:10 AM
In T187154#6041485, @Anomie wrote:

and also an interesting case of the same values being stored twice, which I haven't quite figured out why yet either.

Looks like ->credits came first, then T108269: $wgExtensionCredits handling in ExtensionProcessor/ExtensionRegistry is weird duplicated it into ->globals.

Not really sure what 2015 me was thinking in that task.

Based on your and Krinkle's analysis, I think we should have ExtensionRegistry stop adding credits to the global but continue to support allowing legacy PHP entrypoints to write/append to $wgExtensionCredits. Then we introduce a PHP function somewhere that combines the two, which can be called from Special:Version and the API. Trying to read from $wgExtensionCredits outside of that function is discouraged/deprecated and becomes hit or miss basically.

ReleaseTaggerBot added a project: MW-1.35-notes (1.35.0-wmf.28; 2020-04-14).Apr 9 2020, 4:00 AM
Krinkle mentioned this in T249859: Unable to merge CentralAuth patches (master does not satisfy mwext-php72-phan-seccheck-docker in CI).Apr 13 2020, 3:20 PM
gerritbot added a comment.Apr 18 2020, 1:09 AM

Change 589577 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/Flow@master] Move most Flow files to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589577

gerritbot added a comment.Apr 18 2020, 1:10 AM

Change 555008 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/SecurePoll@master] Namespace-ification!

https://gerrit.wikimedia.org/r/555008

gerritbot added a comment.Apr 18 2020, 1:26 AM

Change 589577 merged by jenkins-bot:
[mediawiki/extensions/Flow@master] Move most Flow files to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589577

gerritbot added a comment.Apr 18 2020, 1:26 AM

Change 589775 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/JsonConfig@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589775

gerritbot added a comment.Apr 18 2020, 1:29 AM

Change 589777 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/SiteMatrix@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589777

gerritbot added a comment.Apr 18 2020, 1:31 AM

Change 589778 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/PageAssessments@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589778

gerritbot added a comment.Apr 18 2020, 1:34 AM

Change 589779 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/GettingStarted@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589779

gerritbot added a comment.Apr 18 2020, 1:37 AM

Change 589780 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/Graph@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589780

gerritbot added a comment.Apr 18 2020, 1:48 AM

Change 589784 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/GlobalUserPage@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589784

gerritbot added a comment.Apr 18 2020, 1:49 AM

Change 589785 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/FileExporter@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589785

gerritbot added a comment.Apr 18 2020, 1:51 AM

Change 589787 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/InterwikiSorting@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589787

gerritbot added a comment.Apr 18 2020, 1:52 AM

Change 589788 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/ExternalGuidance@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589788

gerritbot added a comment.Apr 18 2020, 1:53 AM

Change 589790 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/TemplateWizard@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589790

ReleaseTaggerBot edited projects, added MW-1.35-notes (1.35.0-wmf.30; 2020-04-28); removed MW-1.35-notes (1.35.0-wmf.28; 2020-04-14).Apr 18 2020, 2:00 AM
gerritbot added a comment.Apr 18 2020, 2:29 AM

Change 589780 merged by jenkins-bot:
[mediawiki/extensions/Graph@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589780

gerritbot added a comment.Apr 18 2020, 2:45 AM

Change 589777 merged by jenkins-bot:
[mediawiki/extensions/SiteMatrix@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589777

gerritbot added a comment.Apr 18 2020, 2:45 AM

Change 589784 merged by jenkins-bot:
[mediawiki/extensions/GlobalUserPage@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589784

gerritbot added a comment.Apr 18 2020, 2:46 AM

Change 589775 merged by jenkins-bot:
[mediawiki/extensions/JsonConfig@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589775

gerritbot added a comment.Apr 18 2020, 2:46 AM

Change 589785 merged by jenkins-bot:
[mediawiki/extensions/FileExporter@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589785

gerritbot added a comment.Apr 18 2020, 2:46 AM

Change 589788 merged by jenkins-bot:
[mediawiki/extensions/ExternalGuidance@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589788

gerritbot added a comment.Apr 18 2020, 2:52 AM

Change 589790 merged by jenkins-bot:
[mediawiki/extensions/TemplateWizard@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589790

gerritbot added a comment.Apr 18 2020, 2:52 AM

Change 589787 merged by jenkins-bot:
[mediawiki/extensions/InterwikiSorting@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589787

gerritbot added a comment.Apr 18 2020, 2:52 AM

Change 589779 merged by jenkins-bot:
[mediawiki/extensions/GettingStarted@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589779

gerritbot added a comment.Apr 18 2020, 2:52 AM

Change 589778 merged by jenkins-bot:
[mediawiki/extensions/PageAssessments@master] Swap AutoloadClasses for AutoloadNamespaces

https://gerrit.wikimedia.org/r/589778

gerritbot added a comment.Apr 18 2020, 2:59 AM

Change 589798 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/skins/Vector@master] Move some more classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589798

Reedy mentioned this in rEFILEEXPORT49f818ac2a4d: Swap AutoloadClasses for AutoloadNamespaces.Apr 18 2020, 3:01 AM
Reedy mentioned this in rESMXeb6fac680203: Swap AutoloadClasses for AutoloadNamespaces.
Reedy mentioned this in rEGRAb94126282a06: Swap AutoloadClasses for AutoloadNamespaces.Apr 18 2020, 3:04 AM
gerritbot added a comment.Apr 18 2020, 3:06 AM

Change 589799 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/Babel@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589799

gerritbot added a comment.Apr 18 2020, 3:16 AM

Change 589801 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/MassMessage@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589801

gerritbot added a comment.Apr 18 2020, 3:18 AM

Change 589802 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/Collection@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589802

gerritbot added a comment.Apr 18 2020, 3:19 AM

Change 589803 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/CirrusSearch@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589803

gerritbot added a comment.Apr 18 2020, 3:22 AM

Change 589805 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/WikimediaEvents@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589805

gerritbot added a comment.Apr 18 2020, 3:24 AM

Change 589807 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/PageImages@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589807

gerritbot added a comment.Apr 18 2020, 2:59 PM

Change 589799 merged by jenkins-bot:
[mediawiki/extensions/Babel@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589799

gerritbot added a comment.Apr 18 2020, 2:59 PM

Change 589802 merged by jenkins-bot:
[mediawiki/extensions/Collection@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589802

gerritbot added a comment.Apr 18 2020, 2:59 PM

Change 589807 merged by jenkins-bot:
[mediawiki/extensions/PageImages@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589807

gerritbot added a comment.Apr 18 2020, 2:59 PM

Change 589801 merged by jenkins-bot:
[mediawiki/extensions/MassMessage@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589801

gerritbot added a comment.Apr 18 2020, 2:59 PM

Change 589805 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589805

gerritbot added a comment.Apr 18 2020, 3:04 PM

Change 589798 merged by jenkins-bot:
[mediawiki/skins/Vector@master] Move some more classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589798

gerritbot added a comment.Apr 18 2020, 3:34 PM

Change 589863 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/MassMessage@master] Fixup namespacing in MassMessage

https://gerrit.wikimedia.org/r/589863

gerritbot added a comment.Apr 18 2020, 3:46 PM

Change 589865 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/LocalisationUpdate@master] Namespace LocalisationUpdate class

https://gerrit.wikimedia.org/r/589865

gerritbot added a comment.Apr 18 2020, 3:46 PM

Change 589866 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/LocalisationUpdate@master] Fix namespacing for rest of the classes

https://gerrit.wikimedia.org/r/589866

gerritbot added a comment.Apr 18 2020, 3:55 PM

Change 589867 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/skins/MinervaNeue@master] Move some more classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589867

gerritbot added a comment.Apr 18 2020, 4:03 PM

Change 589870 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/EventBus@master] Correctly namespace Rest classes

https://gerrit.wikimedia.org/r/589870

gerritbot added a comment.Apr 18 2020, 6:15 PM

Change 589863 merged by jenkins-bot:
[mediawiki/extensions/MassMessage@master] Fixup namespacing in MassMessage

https://gerrit.wikimedia.org/r/589863

gerritbot added a comment.Apr 18 2020, 6:15 PM

Change 589865 merged by jenkins-bot:
[mediawiki/extensions/LocalisationUpdate@master] Namespace LocalisationUpdate class

https://gerrit.wikimedia.org/r/589865

gerritbot added a comment.Apr 18 2020, 6:15 PM

Change 589866 merged by jenkins-bot:
[mediawiki/extensions/LocalisationUpdate@master] Fix namespacing for rest of the classes

https://gerrit.wikimedia.org/r/589866

gerritbot added a comment.Apr 18 2020, 6:23 PM

Change 589867 merged by jenkins-bot:
[mediawiki/skins/MinervaNeue@master] Move some more classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589867

Framawiki unsubscribed.Apr 18 2020, 7:58 PM
gerritbot added a comment.Apr 18 2020, 11:29 PM

Change 590004 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/MobileFrontend@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/590004

gerritbot added a comment.Apr 18 2020, 11:41 PM

Change 590006 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/CirrusSearch@master] Namespace maintenance scripts and use AutoloadNamespaces

https://gerrit.wikimedia.org/r/590006

gerritbot added a comment.Apr 18 2020, 11:43 PM

Change 590009 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/Echo@master] Move one class to AutoloadNamespaces

https://gerrit.wikimedia.org/r/590009

gerritbot added a comment.Apr 19 2020, 8:43 PM

Change 590004 merged by jenkins-bot:
[mediawiki/extensions/MobileFrontend@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/590004

gerritbot added a comment.Apr 20 2020, 2:50 PM

Change 589870 merged by jenkins-bot:
[mediawiki/extensions/EventBus@master] Namespace EventBus extension

https://gerrit.wikimedia.org/r/589870

gerritbot added a comment.Apr 20 2020, 4:40 PM

Change 589803 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Move some classes to AutoloadNamespaces

https://gerrit.wikimedia.org/r/589803

gerritbot added a comment.Apr 20 2020, 6:41 PM

Change 591126 had a related patch set uploaded (by Reedy; owner: Reedy):
[mediawiki/extensions/CirrusSearch@master] Use AutoloadNamespaces for maintenance scripts

https://gerrit.wikimedia.org/r/591126

Krinkle updated the task description. (Show Details)Apr 20 2020, 7:23 PM
gerritbot added a comment.Apr 22 2020, 5:18 PM

Change 591126 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Use AutoloadNamespaces for maintenance scripts

https://gerrit.wikimedia.org/r/591126

gerritbot added a comment.Apr 28 2020, 1:10 PM

Change 555008 merged by jenkins-bot:
[mediawiki/extensions/SecurePoll@master] Namespace-ification!

https://gerrit.wikimedia.org/r/555008

Krinkle removed a parent task: T189966: Audit and simplify MediaWiki initialisation code (Spring 2018).Apr 30 2020, 1:40 AM
Krinkle mentioned this in T189966: Audit and simplify MediaWiki initialisation code (Spring 2018).
gerritbot added a comment.Apr 30 2020, 6:23 PM

Change 590009 merged by jenkins-bot:
[mediawiki/extensions/Echo@master] Move one class to AutoloadNamespaces

https://gerrit.wikimedia.org/r/590009

ReleaseTaggerBot edited projects, added MW-1.35-notes (1.35.0-wmf.31; 2020-05-05); removed MW-1.35-notes (1.35.0-wmf.30; 2020-04-28).Apr 30 2020, 7:00 PM
Krinkle moved this task from Blocked (old) to Doing (old) on the Performance-Team board.May 12 2020, 5:56 PM
gerritbot added a comment.May 12 2020, 7:27 PM

Change 595982 had a related patch set uploaded (by Physikerwelt; owner: Physikerwelt):
[mediawiki/extensions/Math@master] Move checking code to a new namespace

https://gerrit.wikimedia.org/r/595982

gerritbot added a comment.May 12 2020, 8:04 PM

Change 595982 merged by jenkins-bot:
[mediawiki/extensions/Math@master] Move checking code to a new namespace

https://gerrit.wikimedia.org/r/595982

gerritbot added a comment.May 25 2020, 6:46 PM

Change 598522 had a related patch set uploaded (by Krinkle; owner: Krinkle):
[mediawiki/core@master] SpecialVersion: Consolidate internal use of wgExtensionCredits

https://gerrit.wikimedia.org/r/598522

gerritbot added a comment.May 25 2020, 6:46 PM

Change 598523 had a related patch set uploaded (by Krinkle; owner: Krinkle):
[mediawiki/core@master] ExtensionRegistry: Remove exporting and caching of wgExtensionCredits

https://gerrit.wikimedia.org/r/598523

gerritbot added a comment.May 28 2020, 3:44 PM

Change 598522 merged by jenkins-bot:
[mediawiki/core@master] SpecialVersion: Consolidate internal use of wgExtensionCredits

https://gerrit.wikimedia.org/r/598522

ReleaseTaggerBot edited projects, added MW-1.35-notes (1.35.0-wmf.35; 2020-06-02); removed MW-1.35-notes (1.35.0-wmf.31; 2020-05-05).May 28 2020, 4:00 PM
gerritbot added a comment.May 28 2020, 7:12 PM

Change 598523 merged by jenkins-bot:
[mediawiki/core@master] ExtensionRegistry: Remove exporting and caching of wgExtensionCredits

https://gerrit.wikimedia.org/r/598523

Krinkle closed this task as Resolved.EditedJun 9 2020, 6:52 PM
Krinkle edited projects, added Performance-Team (Radar), MediaWiki-Configuration; removed MW-1.35-notes (1.35.0-wmf.35; 2020-06-02), Patch-For-Review, Wikimedia-Incident, Performance-Team, Platform Team Workboards (Clinic Duty Team), Release-Engineering-Team-TODO.

Unfortunately ExtensionRegistry::loadFromQueue and its APCUBagOStuff::doGet call are still taking up prettuy much the same 8-10% of load.php as they did before we started.

I'm gonna close this for now as I've spent a lot of time on this and I'm just accepting for now that php-apcu is significantly slower than hhvm-apc. We know this already and it make sense considering that it has to copy these deep and wide arrays recursively into the current request threads whereas HHVM was cheating a bit by not doing any kind of GC or LRU on its APC memory, thus allowing threads to just read the shared memory directly without worrying about things falling out mid-request.

We've optimised it a bit, and it may've made a small improvement but not enough to have high confidence, and definitely not enough to have recovered from the regression. For now I'll shift my focus on other tasks that affect MW WebStart performance and regain our response times that way instead.

Examples:

Krinkle edited projects, added Performance-Team; removed Performance-Team (Radar).Jun 9 2020, 6:52 PM
Aklapper removed a subscriber: Anomie.Oct 16 2020, 5:40 PM
Krinkle mentioned this in T295718: Feedback request: SettingsLoader: move DefaultSettings.php to YAML.Nov 30 2021, 11:49 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits