Master’s Thesis Presentation • Data Systems • Test Collections for Web-scale Datasets Using Dynamic SamplingExport this event to calendar

Friday, December 10, 2021 — 10:00 AM EST

Please note: This master’s thesis presentation will be given online. Please also note new date: Friday, December 10.

Anmol Singh, Master’s candidate
David R. Cheriton School of Computer Science

Supervisor: Professor Gordon Cormack

Dynamic Sampling is a non-uniform sampling strategy used for the construction of statistical test collections for evaluating information retrieval systems. Dynamic Sampling has been shown to lead to comparable or better test collections compared to pooling methods, at a fraction of the assessment effort.

We adapt a high-recall retrieval system to run a Dynamic Sampling protocol for web-scale datasets, and use this to create relevance assessments for 30 topics from the TREC 2019 Medical Misinformation Track. We compare our relevance assessments to qrels created using two pooling-based approaches. We also compare the official NIST qrels, which were based on ClueWeb12B (7% of the full dataset), to qrels based on the full ClueWeb12 dataset.


To join this master’s thesis presentation on Zoom, please go to https://uwaterloo.zoom.us/j/99934447820?pwd=ZkJwOGRSV2hpbThIajNPb01HUVRwQT09.

Please email Joe Petrik if you require the passcode for this presentation.

Location 
Online master’s thesis presentation
200 University Avenue West

Waterloo, ON N2L 3G1
Canada
Event tags 

S M T W T F S
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
2
3
4
  1. 2022 (101)
    1. June (4)
    2. May (16)
    3. April (24)
    4. March (22)
    5. February (16)
    6. January (19)
  2. 2021 (210)
    1. December (21)
    2. November (13)
    3. October (12)
    4. September (21)
    5. August (20)
    6. July (17)
    7. June (11)
    8. May (16)
    9. April (27)
    10. March (20)
    11. February (13)
    12. January (19)
  3. 2020 (217)
  4. 2019 (255)
  5. 2018 (217)
  6. 2017 (36)
  7. 2016 (21)
  8. 2015 (36)
  9. 2014 (33)
  10. 2013 (23)
  11. 2012 (4)
  12. 2011 (1)
  13. 2010 (1)
  14. 2009 (1)
  15. 2008 (1)