Request for anonymized replay data dump

[sry9681]

Hi,

I am building a small open-source tool that estimates each player's role from a finished game's public events, and I want to test how accurate it is against real games.

Your README mentions you can provide a dump of the anonymized profile and replay data for analysis. Would you be willing to share that dump? I only need anonymized data, with no player identities.

What is the best way to continue this conversation or receive the dump?

Thanks!

[cozuya]

e03ef09

that was removed from the README 9 months ago (by me) as I'm not the biggest fan of AI being trained on all of this even anonymously.

So I'd lean no but if its something somewhat altruistic (like for a school project) then maybe? If its just to mess around with, I can run a mongosh query or two if you have something really tight/focused? I'm somewhat interested myself just would take a lot of effort and again don't really want openai slurping up these 2 million games with 2k+ human chats in some of them.

[Vigasaurus]

There are these old ones, which we still leave available and probably serve your purpose as-is, without being too broad/concerning for the current landscape.

It's 2 sets of .tar.gz files, each with 25,000 .json files with game data.

http://secrethitler.io/public/gameDumps/gameSummaries.tar.gz

http://secrethitler.io/public/gameDumps/gameDumps.tar.gz

The former is replay data, with game actions etc, and the latter has chats and simple game outcome data. No guarantees that all 25k are matched in the games they refer to, but as I recall, at least several thousand are. If you need any help parsing it or otherwise, multiple people somewhat active in our Discord have developed tools and may have tips and tricks to do it better (not me, don't ask) and have done some things with them in the past.

[georgempla]

To add on to this I am looking to build some good bots that can play the game when there are not enough players since there aren't any good ones. Everything will of course be open source (except from anything you would like to not be released). For now I will use the dumps provided here but I would love some even newer data.

[sry9681]

I will see what I can do with the current dumps once I have some time later this week or next to look into it. To answer some questions about the purpose of it, I was going to create a tool/site that I was going to open source (or can keep private to pad my resume only, your choice really) to just provide a percent chance of each player being fascist or liberal based upon how they play. It seems like there would be overlap with what @georgempla is wanting to create so maybe we can work together on it. I haven't looked at the files yet but the best data would be player data and chats (to implement detected lying/truth-telling as an advanced skill to modify the percentages as the game goes on). I am doing it for fun because it seems cool and to skill up my coding but was mainly going to be built for IRL Secret Hitler games.

[georgempla]

sure @sry9681 I would love to collaborate on this. We should take this to discord, mine is .ggolf