Search Platform/Weekly Updates/2024-09-27
Appearance
Summary
Lots of people out this week (including attending OpenSearch conference), we made only limited progress.
As part of the WDQS Graph Split work, we want to start exposing an stream of RDF updates publicly to that it can be used to test alternative implementations. We will focus on exposing a stream of changes, but we will not at this time provide additional tooling to consume it.
What we've accomplished
WDQS Graph Split
- T373391 Create wdqs-main and wdqs-scholarly specific test queries
- Creating the work structure to expose the WDQS RDF change stream publicly - https://phabricator.wikimedia.org/T294133 (and subtasks)
Misc
- Adding SSL support for the rdf flink job when it connects to kafka, will deploy this alongside the use of the better discovery technique for kafka brokers - https://phabricator.wikimedia.org/T333373
- First draft of our goals for Q2: https://docs.google.com/document/d/1A9ZwQI3mFPJyzR3GQUlYPo0eYbpqzJ3dTGpqD9FcLG0/edit