Issue with dvc pull (missing cache files) & Goal to extract 'transfer_id'

[ulysse-beaudouin]

Hi,

I am trying to set up the project locally following the documentation. I installed the environment with Poetry successfully.

However, when I try to retrieve the data using dvc pull, I get a "Missing cache files" error, suggesting the data is not available on the remote storage anymore.

Plaintext

ERROR: failed to pull data from the cloud - Checkout failed for following targets:
data/prep
data/raw/transfermarkt-scraper
...
Because of this, I cannot run the local acquisition scripts (like make acquire_local) since I am missing the base files (e.g., players.json in data/raw).

Is the S3 bucket currently down or is there another way to get the initial raw data?

Thanks!

[dcaribou]

Hi @ulysse-beaudouin. Yes, the remote storage is currently disabled. I need to implement some additional security around it before I can enable it again.

If all you want to do for now is to run the api acquisition script to get the market values you can try this file for the input. This is the latest version of the raw players file (data/raw/transfermarkt-scraper/2024/players.json.gz)

players.json.gz