Vector-based indexing of Federal Supreme Court judgments - On November 13, 2024
Thomas Murphy reported at the DA-3 workshop on the retrieval effectiveness of LLM-based search methods to find relevant judgments of the Swiss Federal Supreme Court. To determine the search quality - whether relevant judgments are effectively found or not - a test collection is essential. Thomas uses a test collection from Eurospider with 123 test queries for which the relevant judgments are known. He compared the retrieval effectiveness of different search methods based on their yield and precision precision and recall. After numerous experiments, an improvement was achieved on the test collection with a combination of LLM-based vector retrieval and text retrieval optimized for legal information.
More Information This email address is being protected from spambots. You need JavaScript enabled to view it..
