[EPIC] Backend: cross-wiki search results functionality
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	debt
	Sep 16 2016, 11:46 PM

Description

As a team, and based on feedback generated on MediaWiki and the talk page, we want to create methods and functionality to generate and display additional (and relevant) search results on Wikipedia that are from other sister projects and the native language wiki where the user entered their search query.

Our goal in this effort is to add this functionality onto Wikipedia and gather results from other projects to display on the search results page. These search results will be in the same language as the search was done in - i.e.: if I search on en.wiki for what is the history of the olympics I want to see search results in English on en.wiki and also relevant results (in English) from sister projects such as wikiquote, wiktionary, wikivoyage, etc.

We've discussed this in various different meetings, here are the etherpad notes that contain the raw minutes from those meetings, in order to refresh our memories (listed in no particular order):

This ticket is to cover the backend functionality that we need to build to support the front end display (T145917)

Related Objects
Search...

Status	Assigned	Task
Resolved	debt	T145918 [EPIC] Backend: cross-wiki search results functionality
Resolved	EBernhardson	T146179 Enable cross-wiki backend search functionality on it.wikipedia
Resolved	EBernhardson	T96881 Don't show the "results from other projects" box if empty
Resolved	• demon	T46420 Restore interwiki (sister projects) results in search queries
Resolved	CKoerner_WMF	T137312 Work with communities to learn how inter-wiki search might work
Resolved	EBernhardson	T146710 Backend work for cross-wiki search results: questions to agree upon solutions for
Declined	None	T146714 Backend work for cross-wiki search results: CirrusSearch configuration
Declined	None	T146719 Backend work for cross-wiki search results: do we want/need to have per wiki completion searches
Declined	None	T146790 Backend work for cross-wiki search results: implement query for cross-wiki results display
Resolved	dcausse	T147003 When using the search api interwiki should only be queried when srinterwiki=1 is passed as a parameter
Resolved	EBernhardson	T149740 Run load tests of cross-project searching to verify its stability
Resolved	EBernhardson	T149741 Improve how search queries are built for cross-wiki searches to allow for better filtering
Declined	None	T151935 Cross-wiki search results: making sure the results are relevant from sister projects
Resolved	dcausse	T156298 create ability to re-order search results based on recall and randomly
Resolved	dcausse	T156299 update configuration settings for sister search AB test
Declined	None	T156254 Add wikispecies into inter-wiki search indexes

Event Timeline

debt created this task.Sep 16 2016, 11:46 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 16 2016, 11:46 PM

debt mentioned this in T145917: [EPIC] Front end: cross-wiki search results display.Sep 16 2016, 11:46 PM

debt updated the task description. (Show Details)

debt added a project: Epic.

debt triaged this task as Medium priority.Sep 16 2016, 11:49 PM

debt mentioned this in T139310: [UI design] Search Results page: re-design page display of search results across languages.Sep 17 2016, 12:00 AM

Duplicate of T109957 ? (And if not, how are these two tasks related?)

This ticket is to do the work of creating the ability - frontend and backend - to gather and display cross-wiki query results on the Wikipedia search results page.

This new functionality won't display search results from every sister project, due to technical limitations, and we'll be working on bringing this new functionality on Wikipedia only (showing relevant results from other projects). We're also concentrating on using only the relevant same language projects as the language Wikipedia that the user is searching on - i.e.: en.wiki will search for relevant results from en.wikivoyage, en.wikiquote, etc.

This ticket is different from T109957 because that ticket discusses showing search results from ALL projects. A handful of language wiki's do that now but their indexes are much smaller than en.wiki and don't cause huge delays in displaying results, as mentioned here.

debt created subtask T146179: Enable cross-wiki backend search functionality on it.wikipedia.Sep 20 2016, 5:59 PM

debt added a subtask: T137312: Work with communities to learn how inter-wiki search might work.Sep 26 2016, 10:13 PM

debt mentioned this in T137312: Work with communities to learn how inter-wiki search might work.

debt mentioned this in T146710: Backend work for cross-wiki search results: questions to agree upon solutions for.Sep 26 2016, 11:03 PM

debt created subtask T146710: Backend work for cross-wiki search results: questions to agree upon solutions for.

debt created subtask T146713: Backend work for cross-wiki search results: deployment and switchover.Sep 26 2016, 11:07 PM

debt created subtask T146714: Backend work for cross-wiki search results: CirrusSearch configuration.Sep 26 2016, 11:10 PM

debt created subtask T146715: Backend work for cross-wiki search results: centralize document id and namespace generation.Sep 26 2016, 11:12 PM

debt created subtask T146716: Backend work for cross-wiki search results: scoring and ranking across wiki projects.Sep 26 2016, 11:15 PM

debt created subtask T146717: Backend work for cross-wiki search results: did you mean (DYM) recommendations.Sep 26 2016, 11:19 PM

debt created subtask T146719: Backend work for cross-wiki search results: do we want/need to have per wiki completion searches.Sep 26 2016, 11:24 PM

debt moved this task from Incoming to Cross-Wiki work on the Discovery-Search (Current work) board.Sep 27 2016, 1:15 PM

debt created subtask T146790: Backend work for cross-wiki search results: implement query for cross-wiki results display.Sep 27 2016, 5:31 PM

debt closed subtask T146719: Backend work for cross-wiki search results: do we want/need to have per wiki completion searches as Declined.

CKoerner_WMF closed subtask T137312: Work with communities to learn how inter-wiki search might work as Resolved.Sep 27 2016, 8:45 PM

EBernhardson created subtask T147003: When using the search api interwiki should only be queried when srinterwiki=1 is passed as a parameter.Sep 29 2016, 5:04 PM

debt closed subtask T147003: When using the search api interwiki should only be queried when srinterwiki=1 is passed as a parameter as Resolved.Oct 7 2016, 9:17 PM

Liuxinyu970226 subscribed.Oct 10 2016, 5:22 AM

The above tasks have been removed as they no longer block the deployment of cross-wiki search functionality. Those tasks have been moved to T148554: [EPIC] Merging indices into cross-project indices after cross-wiki search deployment.

• Deskana mentioned this in T148554: [EPIC] Merging indices into cross-project indices after cross-wiki search deployment.Oct 18 2016, 5:59 PM

• Deskana closed subtask T146179: Enable cross-wiki backend search functionality on it.wikipedia as Resolved.Oct 28 2016, 4:25 AM