Evaluating Retrieval for Multi-domain Scientific Publications
Proceedings of the Thirteenth Language Resources and Evaluation …, 2022•aclanthology.org
This paper provides an overview of the xDD/LAPPS Grid framework and provides results of
evaluating the AskMe retrievalengine using the BEIR benchmark datasets. Our primary goal
is to determine a solid baseline of performance to guide furtherdevelopment of our retrieval
capabilities. Beyond this, we aim to dig deeper to determine when and why certain
approachesperform well (or badly) on both in-domain and out-of-domain data, an issue that
has to date received relatively little attention.
evaluating the AskMe retrievalengine using the BEIR benchmark datasets. Our primary goal
is to determine a solid baseline of performance to guide furtherdevelopment of our retrieval
capabilities. Beyond this, we aim to dig deeper to determine when and why certain
approachesperform well (or badly) on both in-domain and out-of-domain data, an issue that
has to date received relatively little attention.
Abstract
This paper provides an overview of the xDD/LAPPS Grid framework and provides results of evaluating the AskMe retrievalengine using the BEIR benchmark datasets. Our primary goal is to determine a solid baseline of performance to guide furtherdevelopment of our retrieval capabilities. Beyond this, we aim to dig deeper to determine when and why certain approachesperform well (or badly) on both in-domain and out-of-domain data, an issue that has to date received relatively little attention.
aclanthology.org
Showing the best result for this search. See all results