Skip to content

Add to onboarding reproduction logs - #2653

Open
akhilmajhi2006 wants to merge 2 commits into
castorini:masterfrom
akhilmajhi2006:master
Open

Add to onboarding reproduction logs#2653
akhilmajhi2006 wants to merge 2 commits into
castorini:masterfrom
akhilmajhi2006:master

Conversation

@akhilmajhi2006

Copy link
Copy Markdown

Reproduced the Lesson 8 onboarding exercise for SPLADE-v3.

Environment:

  • Windows
  • Python 3.12
  • CPU
  • Pyserini from source

Results:

  • SPLADE-v3 encoding completed successfully for 3,633 NFCorpus documents.
  • Lucene impact index created successfully with 3,633 documents and 0 errors.
  • Retrieval completed for 3,237 queries.
  • nDCG@10: 0.3612 (documented expected result: 0.3624).
  • Interactive retrieval results matched the documented Lesson 8 results exactly.

The reproduction log has been added to docs/conceptual-framework3.md.

@lintool

lintool commented Aug 28, 2026

Copy link
Copy Markdown
Member

Please don't add any extra files.
What happened to the other lessons?

@akhilmajhi2006 akhilmajhi2006 changed the title Add Lesson 8 reproduction log Add to onboarding reproduction logs Aug 28, 2026
@akhilmajhi2006

akhilmajhi2006 commented Aug 28, 2026 via email

Copy link
Copy Markdown
Author

@lintool

lintool commented Aug 28, 2026

Copy link
Copy Markdown
Member

I had only added the Lesson 8 reproduction log to the PR, which is why the earlier lessons aren't reflected there.

I believe the instructions were clear about appending an entry for every lesson?

@akhilmajhi2006

Copy link
Copy Markdown
Author

Thanks for pointing this out. I initially only added the Lesson 8 reproduction entry. I have now updated the Pyserini PR to include the reproduction-log entries for the earlier conceptual-framework lessons as well. The Anserini and Pyserini work was completed separately in their respective repositories.

@lintool

lintool commented Aug 29, 2026

Copy link
Copy Markdown
Member

You're still missing repro entries...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants