Error
- mwversion: 1.39.0-wmf.19
- reqId: ff4d8101-074f-4902-b350-6eacc15229a6
- Find reqId in Logstash
Deferred update '{deferred_type}' failed to run.
from /srv/mediawiki/php-1.39.0-wmf.19/vendor/wikimedia/request-timeout/src/Detail/ExcimerTimerWrapper.php(97) #0 /srv/mediawiki/php-1.39.0-wmf.19/vendor/wikimedia/request-timeout/src/Detail/ExcimerTimerWrapper.php(72): Wikimedia\RequestTimeout\Detail\ExcimerTimerWrapper->onTimeout(integer) #1 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Handler/CurlFactory.php(563): Wikimedia\RequestTimeout\Detail\ExcimerTimerWrapper->Wikimedia\RequestTimeout\Detail\{closure}(integer) #2 [internal function]: GuzzleHttp\Handler\CurlFactory::GuzzleHttp\Handler\{closure}(resource, string) #3 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Handler/CurlHandler.php(44): curl_exec(resource) #4 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Handler/Proxy.php(28): GuzzleHttp\Handler\CurlHandler->__invoke(GuzzleHttp\Psr7\Request, array) #5 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Handler/Proxy.php(48): GuzzleHttp\Handler\Proxy::GuzzleHttp\Handler\{closure}(GuzzleHttp\Psr7\Request, array) #6 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Middleware.php(240): GuzzleHttp\Handler\Proxy::GuzzleHttp\Handler\{closure}(GuzzleHttp\Psr7\Request, array) #7 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/PrepareBodyMiddleware.php(35): GuzzleHttp\Middleware::GuzzleHttp\{closure}(GuzzleHttp\Psr7\Request, array) #8 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/RedirectMiddleware.php(55): GuzzleHttp\PrepareBodyMiddleware->__invoke(GuzzleHttp\Psr7\Request, array) #9 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Middleware.php(61): GuzzleHttp\RedirectMiddleware->__invoke(GuzzleHttp\Psr7\Request, array) #10 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/HandlerStack.php(75): GuzzleHttp\Middleware::GuzzleHttp\{closure}(GuzzleHttp\Psr7\Request, array) #11 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Client.php(331): GuzzleHttp\HandlerStack->__invoke(GuzzleHttp\Psr7\Request, array) #12 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Client.php(108): GuzzleHttp\Client->transfer(GuzzleHttp\Psr7\Request, array) #13 /srv/mediawiki/php-1.39.0-wmf.19/vendor/guzzlehttp/guzzle/src/Client.php(123): GuzzleHttp\Client->sendAsync(GuzzleHttp\Psr7\Request, array) #14 /srv/mediawiki/php-1.39.0-wmf.19/includes/http/GuzzleHttpRequest.php(203): GuzzleHttp\Client->send(GuzzleHttp\Psr7\Request) #15 /srv/mediawiki/php-1.39.0-wmf.19/includes/http/HttpRequestFactory.php(174): GuzzleHttpRequest->execute() #16 /srv/mediawiki/php-1.39.0-wmf.19/includes/http/HttpRequestFactory.php(196): MediaWiki\Http\HttpRequestFactory->request(string, string, array, string) #17 /srv/mediawiki/php-1.39.0-wmf.19/includes/filerepo/file/ForeignDBFile.php(132): MediaWiki\Http\HttpRequestFactory->get(string, array, string) #18 /srv/mediawiki/php-1.39.0-wmf.19/includes/libs/objectcache/wancache/WANObjectCache.php(1694): ForeignDBFile::{closure}(boolean, integer, array, NULL, array) #19 /srv/mediawiki/php-1.39.0-wmf.19/includes/libs/objectcache/wancache/WANObjectCache.php(1523): WANObjectCache->fetchOrRegenerate(string, integer, Closure, array, array) #20 /srv/mediawiki/php-1.39.0-wmf.19/includes/filerepo/file/ForeignDBFile.php(138): WANObjectCache->getWithSetCallback(string, integer, Closure) #21 /srv/mediawiki/php-1.39.0-wmf.19/extensions/CommonsMetadata/src/DataCollector.php(264): ForeignDBFile->getDescriptionText(LanguageEn) #22 /srv/mediawiki/php-1.39.0-wmf.19/extensions/CommonsMetadata/src/DataCollector.php(98): CommonsMetadata\DataCollector->getDescriptionText(ForeignDBFile, LanguageEn) #23 /srv/mediawiki/php-1.39.0-wmf.19/extensions/CommonsMetadata/src/HookHandler.php(75): CommonsMetadata\DataCollector->collect(array, ForeignDBFile) #24 /srv/mediawiki/php-1.39.0-wmf.19/includes/HookContainer/HookContainer.php(338): CommonsMetadata\HookHandler::onGetExtendedMetadata(array, ForeignDBFile, RequestContext, boolean, integer) #25 /srv/mediawiki/php-1.39.0-wmf.19/includes/HookContainer/HookContainer.php(137): MediaWiki\HookContainer\HookContainer->callLegacyHook(string, array, array, array) #26 /srv/mediawiki/php-1.39.0-wmf.19/includes/HookContainer/HookRunner.php(1814): MediaWiki\HookContainer\HookContainer->run(string, array) #27 /srv/mediawiki/php-1.39.0-wmf.19/includes/media/FormatMetadata.php(1821): MediaWiki\HookContainer\HookRunner->onGetExtendedMetadata(array, ForeignDBFile, RequestContext, boolean, integer) #28 /srv/mediawiki/php-1.39.0-wmf.19/includes/media/FormatMetadata.php(1738): FormatMetadata->getExtendedMetadataFromHook(ForeignDBFile, array, integer) #29 /srv/mediawiki/php-1.39.0-wmf.19/extensions/GrowthExperiments/includes/NewcomerTasks/AddImage/ImageRecommendationMetadataService.php(60): FormatMetadata->fetchExtendedMetadata(ForeignDBFile) #30 /srv/mediawiki/php-1.39.0-wmf.19/extensions/GrowthExperiments/includes/NewcomerTasks/AddImage/ImageRecommendationMetadataProvider.php(298): GrowthExperiments\NewcomerTasks\AddImage\ImageRecommendationMetadataService->getExtendedMetadata(string) #31 /srv/mediawiki/php-1.39.0-wmf.19/extensions/GrowthExperiments/includes/NewcomerTasks/AddImage/ServiceImageRecommendationProvider.php(176): GrowthExperiments\NewcomerTasks\AddImage\ImageRecommendationMetadataProvider->getMetadata(array) #32 /srv/mediawiki/php-1.39.0-wmf.19/extensions/GrowthExperiments/includes/NewcomerTasks/AddImage/ServiceImageRecommendationProvider.php(110): GrowthExperiments\NewcomerTasks\AddImage\ServiceImageRecommendationProvider::processApiResponseData(Title, string, array, GrowthExperiments\NewcomerTasks\AddImage\ImageRecommendationMetadataProvider, GrowthExperiments\NewcomerTasks\AddImage\AddImageSubmissionHandler, array) #33 /srv/mediawiki/php-1.39.0-wmf.19/extensions/GrowthExperiments/includes/NewcomerTasks/AddImage/CacheBackedImageRecommendationProvider.php(63): GrowthExperiments\NewcomerTasks\AddImage\ServiceImageRecommendationProvider->get(Title, GrowthExperiments\NewcomerTasks\TaskType\ImageRecommendationTaskType) #34 /srv/mediawiki/php-1.39.0-wmf.19/includes/libs/objectcache/wancache/WANObjectCache.php(1694): GrowthExperiments\NewcomerTasks\AddImage\CacheBackedImageRecommendationProvider::GrowthExperiments\NewcomerTasks\AddImage\{closure}(boolean, integer, array, NULL, array) #35 /srv/mediawiki/php-1.39.0-wmf.19/includes/libs/objectcache/wancache/WANObjectCache.php(1523): WANObjectCache->fetchOrRegenerate(string, integer, Closure, array, array) #36 /srv/mediawiki/php-1.39.0-wmf.19/extensions/GrowthExperiments/includes/NewcomerTasks/AddImage/CacheBackedImageRecommendationProvider.php(68): WANObjectCache->getWithSetCallback(string, integer, Closure) #37 /srv/mediawiki/php-1.39.0-wmf.19/extensions/GrowthExperiments/includes/NewcomerTasks/TaskSetListener.php(47): GrowthExperiments\NewcomerTasks\AddImage\CacheBackedImageRecommendationProvider::getWithSetCallback(WANObjectCache, GrowthExperiments\NewcomerTasks\AddImage\ServiceImageRecommendationProvider, GrowthExperiments\NewcomerTasks\TaskType\ImageRecommendationTaskType, Title) #38 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/MWCallableUpdate.php(38): GrowthExperiments\NewcomerTasks\TaskSetListener->GrowthExperiments\NewcomerTasks\{closure}() #39 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdates.php(474): MWCallableUpdate->doUpdate() #40 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdates.php(399): DeferredUpdates::attemptUpdate(MWCallableUpdate, Wikimedia\Rdbms\LBFactoryMulti) #41 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdates.php(227): DeferredUpdates::run(MWCallableUpdate, Wikimedia\Rdbms\LBFactoryMulti, Monolog\Logger, BufferingStatsdDataFactory, MediaWiki\JobQueue\JobQueueGroupFactory, string) #42 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdatesScope.php(267): DeferredUpdates::{closure}(MWCallableUpdate, integer) #43 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdatesScope.php(196): DeferredUpdatesScope->processStageQueue(integer, integer, Closure) #44 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdates.php(230): DeferredUpdatesScope->processUpdates(integer, Closure) #45 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdatesScope.php(267): DeferredUpdates::{closure}(MWCallableUpdate, integer) #46 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdatesScope.php(196): DeferredUpdatesScope->processStageQueue(integer, integer, Closure) #47 /srv/mediawiki/php-1.39.0-wmf.19/includes/deferred/DeferredUpdates.php(235): DeferredUpdatesScope->processUpdates(integer, Closure) #48 /srv/mediawiki/php-1.39.0-wmf.19/includes/MediaWiki.php(1124): DeferredUpdates::doUpdates() #49 /srv/mediawiki/php-1.39.0-wmf.19/includes/MediaWiki.php(846): MediaWiki->restInPeace() #50 /srv/mediawiki/php-1.39.0-wmf.19/includes/MediaWiki.php(594): MediaWiki->doPostOutputShutdown() #51 /srv/mediawiki/php-1.39.0-wmf.19/index.php(50): MediaWiki->run() #52 /srv/mediawiki/php-1.39.0-wmf.19/index.php(46): wfIndexMain() #53 /srv/mediawiki/w/index.php(3): require(string) #54 {main}
Impact
conversation with @kostajh in #wikimedia-operations:
15:13 <urbanecm> kostajh: okay. i see the timeouts and `Deferred update 'MWCallableUpdate_GrowthExperiments\NewcomerTasks\TaskSetListener->run' failed to run.` again. not sure what the deferred update is for. doesn't appear to show up in the growth-team logstash dashboard. given you say it works, perhaps we should sync and check the errors after? 15:13 <kostajh> urbanecm: the deferred update failure is because we cache calls to the image suggestion API, and processing of metadata. In this case, if it can't find the recommendation, the curl request just hangs. We should try to fix that, but it's not directly related