Skip to content

BEIR dataset comparison -- adding queries2queries and queries2corpus comparison; Fixing bugs#1169

Open
amyxie361 wants to merge 13 commits intocastorini:masterfrom
amyxie361:yuqingxie/q2q_compare
Open

BEIR dataset comparison -- adding queries2queries and queries2corpus comparison; Fixing bugs#1169
amyxie361 wants to merge 13 commits intocastorini:masterfrom
amyxie361:yuqingxie/q2q_compare

Conversation

@amyxie361
Copy link
Copy Markdown
Member

@amyxie361 amyxie361 commented May 12, 2022

fix bug and add query2query query2corpus comparison
New Feature:

  1. enable the columns and row come from different corpus (rows from queries and columns from corpus)

Bugs:

  1. for weighted_jaccard, should use cfs before filter
  2. previously, cfs = dfs = stats = {} will bound the objects together, split them in this pr
  3. default tokenizer should be bert-base-uncased

@amyxie361 amyxie361 changed the title Yuqingxie/q2q compare BEIR dataset comparison -- adding queries2queries and queries2corpus comparison; Fixing bugs May 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant