default search action
Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCIDIan Soboroff
- > Home > Persons > Ian Soboroff
Publications
- 2025
[c113]Rikiya Takehi
, Ellen M. Voorhees, Tetsuya Sakai, Ian Soboroff:
LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help? SIGIR 2025: 95-105- [i16]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Hossein A. Rahmani, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, Ian Soboroff:
Overview of the TREC 2023 deep learning track. CoRR abs/2507.08890 (2025) - [i15]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, Ian Soboroff:
Overview of the TREC 2022 deep learning track. CoRR abs/2507.10865 (2025) - 2024
- [c109]Timo Breuer, Ellen M. Voorhees, Ian Soboroff:
Browsing and Searching Metadata of TREC. SIGIR 2024: 313-323 - 2023
- [c102]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Hossein A. Rahmani, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, Ian Soboroff:
Overview of the TREC 2023 Deep Learning Track. TREC 2023 - 2022
- [c94]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, Ian Soboroff:
Overview of the TREC 2022 Deep Learning Track. TREC 2022 - [i9]Ellen M. Voorhees, Ian Soboroff, Jimmy Lin:
Can Old TREC Collections Reliably Evaluate Modern Neural Retrieval Models? CoRR abs/2201.11086 (2022) - 2021
- [j32]Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, William R. Hersh:
Searching for scientific evidence in a pandemic: An overview of TREC-COVID. J. Biomed. Informatics 121: 103865 (2021) - [c91]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, Ian Soboroff:
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime. SIGIR 2021: 2369-2375 - [i7]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, Ian Soboroff:
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime. CoRR abs/2104.09399 (2021) - [i6]Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, William R. Hersh:
Searching for Scientific Evidence in a Pandemic: An Overview of TREC-COVID. CoRR abs/2104.09632 (2021) - 2020
- [j29]Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, William R. Hersh:
TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19. J. Am. Medical Informatics Assoc. 27(9): 1431-1436 (2020) - [j27]Ellen M. Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R. Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, Lucy Lu Wang:
TREC-COVID: constructing a pandemic information retrieval test collection. SIGIR Forum 54(1): 1:1-1:12 (2020) - [i3]Ellen M. Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R. Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, Lucy Lu Wang:
TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection. CoRR abs/2005.04474 (2020) - 2017
- [j19]Ellen M. Voorhees, Daniel Samarov, Ian Soboroff:
Using Replicates in Information Retrieval Evaluation. ACM Trans. Inf. Syst. 36(2): 12:1-12:21 (2017) - 2016
- [c63]Ellen M. Voorhees, Shahzad Rajput, Ian Soboroff:
Promoting Repeatability Through Open Runs. EVIA@NTCIR 2016 - 2014
- [j17]Ellen M. Voorhees, Paul Over, Ian Soboroff:
Building Better Search Engines by Measuring Search Quality. IT Prof. 16(2): 22-30 (2014) - [c56]John R. Frank, Max Kleiman-Weiner, Daniel A. Roberts, Ellen M. Voorhees, Ian Soboroff:
Evaluating Stream Filtering for Entity Profile Updates in TREC 2012, 2013, and 2014. TREC 2014 - 2013
- [c54]John R. Frank, Steven J. Bauer, Max Kleiman-Weiner, Daniel A. Roberts, Nilesh Tripuraneni, Ce Zhang, Christopher Ré, Ellen M. Voorhees, Ian Soboroff:
Evaluating Stream Filtering for Entity Profile Updates for TREC 2013. TREC 2013 - 2011
- [c49]Charles L. A. Clarke, Nick Craswell, Ian Soboroff, Ellen M. Voorhees:
Overview of the TREC 2011 Web Track. TREC 2011 - 2007
- [j11]Chris Buckley, Darrin Dimmick, Ian Soboroff, Ellen M. Voorhees:
Bias and the limits of pooling for large collections. Inf. Retr. 10(6): 491-508 (2007) - 2006
- [c24]Chris Buckley, Darrin Dimmick, Ian Soboroff, Ellen M. Voorhees:
Bias and the limits of pooling. SIGIR 2006: 619-620 - 2003
- [j7]Ian Soboroff, Ellen M. Voorhees, Nick Craswell:
Summary of the SIGIR 2003 workshop on defining evaluation methodologies for terabyte-scale test collections. SIGIR Forum 37(2): 55-58 (2003)
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from 
to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the 
of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from 
, 
, and 
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from 
.
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2025-08-16 02:50 CEST by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by:
