Search Platform/Weekly Updates/2024-10-18

Summary

• Migration of Elasticsearch plugins continues, migrating to the gradle build system is challenging.
• Flink application processing RDF updates for WDQS is migrated to leverage Event_Platform/Event_Utilities.

What we've accomplished

Flink updates

• We updated & deployed our flink images in response to security issues, see https://phabricator.wikimedia.org/T376886 and https://phabricator.wikimedia.org/T371874

Weighted tags

• Migration of sources of weighted tags to use our our new consolidated event stream continues. Link recommendations is almost complete, despite some trouble after changing the API.

Search backend replacement

• Migrating most Elasticsearch plugins works smoothly, however, Opensearch uses a different build system based on gradle which does not work for all migrated plugins yet.