Search Platform/Weekly Updates/2024-07-05
Appearance
Summary
A new quarter is starting. Our goals for this quarter are not entirely clear yet, but will include:
- Continuing graph split work
- Supporting the migration from Archiva to Gitlab
- Supporting the work of the Web team as needed on WE3.1 (Improve general and personalized browsing)
It might also include:
- Decrease update lag in search for Wikidata edits - https://phabricator.wikimedia.org/T365831
- Deploying the new Search Update Pipeline to private wikis - https://phabricator.wikimedia.org/T341332
- Support the Kafka version upgrade
- Plan the migration from Elasticsearch to OpenSearch
- Define use cases and experiments around vector search
What we've accomplished
Search Update Pipeline
- T331127 phantom redirects lingering in incategory searches after page moves - https://phabricator.wikimedia.org/T331127
Improve multilingual zero-results rate
- looking at the results of deploying the dotted_i_fix - https://phabricator.wikimedia.org/T358495
Misc
- Starting to migrate cirrus icinga alerts to alertmanager - https://phabricator.wikimedia.org/T359033
- was blocked by https://phabricator.wikimedia.org/T369080
- Re-deployed all flink jobs to support restricted PSS - https://phabricator.wikimedia.org/T362978
- looked into the failures of the export_queries_to_relforge dag, there was a missing partition and then relforge failed because of too many shards
- DPE (Andrew & Xabriel) fixed the missing partition
- cleaned up relforge