Human Evaluation Experiment of Legal Information Retrieval Methods
| Authors | |
|---|---|
| Year of publication | 2021 |
| Type | Article in Proceedings |
| Conference | Frontiers in Artificial Intelligence and Applications, Vol. 346 Legal Knowledge and Information Systems. Proceedings of JURIX 2021. |
| MU Faculty or unit | |
| Citation | |
| Web | Open access sborníku |
| Doi | http://dx.doi.org/10.3233/FAIA210328 |
| Keywords | human evaluation; court decisions retrieval; doc2vec; citation analysis; LDA; multilayered approach |
| Description | In this article, I present the results of the human evaluation experiment of three commonly used methods in legal information retrieval and a new ”multilayered” approach. I use the doc2vec model, citation network analysis and two topic modelling algorithms for the Czech Supreme Court decisions retrieval and evaluate their performance. To improve the accuracy of the results of these methods, I combine the methods in a ”multilayered” way and perform the subsequent evaluation. Both evaluation experiments are conducted with a group of legal experts to assess the applicability and usability of the methods for legal information retrieval. The combination of the doc2vec and citations is found satisfactory accurate for practical use for the Czech court decisions retrieval. |
| Related projects: |