OSIRRC 2019 Image Library

This repo catalogs the images that have been submitted to the SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019). The actual raw runs are held in a separate repository.

• Anserini
• Anserini-bm25prf
• ATIRE
• Birch
• Elastirini
• EntityRetrieval
• Galago
• ielab
• Indri
• IRC-CENTRE2019
• JASS
• JASSv2
• NVSM
• OldDog
• PISA
• Solrini
• Terrier

Anserini

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core18	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/28	core17	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/18	core18	Standard_D64s_v3	v0.1.0	v0.1.1
[link]	2019/06/18	core17	Standard_D64s_v3	v0.1.0	v0.1.1
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	v0.1.1
[link]	2019/05/27	robust04	Standard_D64s_v3	2307f2c	dd4fbde

Anserini-bm25prf

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.2.2
[link]	2019/06/21	robust04	Standard_D64s_v3	v0.1.0	v0.2.2

ATIRE

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core17	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/18	core17	Standard_D64s_v3	v0.1.0	0.1.0
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	0.1.0
[link]	2019/05/27	robust04	Standard_D64s_v3	2307f2c	ebdc076

Birch

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.1.0
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	v0.1.0

Elastirini

Elastirini is configured to produce the same exact batch runs as Anserini, but provides an additional interact hook starts up Elasticsearch to support interactive querying.

EntityRetrieval

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/29	robust04	Standard_D64s_v3	v0.1.1	v0.1.1

Galago

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.0.2

ielab

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.0.1

Indri

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.2.1
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	v0.1.0

IRC-CENTRE2019

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core17	Standard_D64s_v3	v0.1.1	v0.1.3
[link]	2019/06/24	core17	Standard_D64s_v3	v0.1.0	v0.1.3

JASS

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core17	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/18	core17	Standard_D64s_v3	v0.1.0	0.1.0
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	0.1.0
[link]	2019/05/27	robust04	Standard_D64s_v3	2307f2c	16480cf

JASSv2

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core17	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.1.1
[link]	2019/06/18	core17	Standard_D64s_v3	v0.1.0	0.1.0
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	0.1.0
[link]	2019/05/27	robust04	Standard_D64s_v3	2307f2c	018981e

NVSM

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/24	robust04	Standard_D64s_v3	v0.1.0	v0.1.0

OldDog

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core18	Standard_D64s_v3	v0.1.1	v1.0.0
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v1.0.0
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	v0.2.0
[link]	2019/05/27	robust04	Standard_D64s_v3	2307f2c	dd8b230

PISA

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core18	Standard_D64s_v3	v0.1.1	v0.1.3
[link]	2019/06/28	core17	Standard_D64s_v3	v0.1.1	v0.1.3
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.1.3
[link]	2019/06/18	core18	Standard_D64s_v3	v0.1.0	v0.1.2
[link]	2019/06/18	core17	Standard_D64s_v3	v0.1.0	v0.1.2
[link]	2019/06/17	robust04	Standard_D64s_v3	v0.1.0	v0.1.2
[link]	2019/05/27	robust04	Standard_D64s_v3	2307f2c	095e9ce

Solrini

Solrini is configured to produce the same exact batch runs as Anserini, but provides an additional interact hook starts up Solr to support interactive querying.

Terrier

Execution log:

Output	Date	Collection	Host	Jig	Image
[link]	2019/06/28	core18	Standard_D64s_v3	v0.1.1	v0.1.7
[link]	2019/06/28	robust04	Standard_D64s_v3	v0.1.1	v0.1.7
[link]	2019/06/20	core18	Standard_D64s_v3	v0.1.0	v0.1.7
[link]	2019/06/20	robust04	Standard_D64s_v3	v0.1.0	v0.1.7