Search Platform/Weekly Updates/2023-04-22
Appearance
Summary
The focus this week has been on annual planning. Other projects are moving along.
What we've accomplished
Search - Analysis
- Blog post written about the work that has been done around unpacking the analyzers. This should be published on Diff after editorial review.
- Brazilian Portuguese has been reindexed, enabling the unpacking of the Brazilian analyzer - https://phabricator.wikimedia.org/T333398
Search - Update Pipeline
- rdf-streaming-updater is now running with Flink Operators on the DSE k8s cluster. This validate the underlying deployment process, so that we can focus on functional aspects again - https://phabricator.wikimedia.org/T328675
Operations / SRE
- Decommission query-preview.wikidata.org, which was used to allow our users to validate the migration to the streaming updater. This migration is completed since long enough that this exposed service isn't needed anymore. - https://phabricator.wikimedia.org/T333656
- Cookbook created to ban / unban nodes, which is required during the upcoming network switch maintenance. Having this automated reduces the potential errors. - https://phabricator.wikimedia.org/T331303
Misc
- Progress made on migrating our integration tests from vagrant to docker. Some polishing is needed, but it seems to be working - https://phabricator.wikimedia.org/T333183
- Reindex of all wikis to enable a new keyword to filter pages by "length" - https://phabricator.wikimedia.org/T328332
- Optimize queries for non-English users on Wikdiata - https://phabricator.wikimedia.org/T323628