-
Notifications
You must be signed in to change notification settings - Fork 7
Labels
data setsAcquiring new data sets to catalog or create.Acquiring new data sets to catalog or create.
Description
Is there an existing issue for this?
- I have searched the existing issues
Task/Feature/Issue Details
Following the established pattern of using the HF API to gather stats on HF datasets, create a job to collect model level stat information.
Only problem here is that we won't be able to collect stats on all the models, as there are 2,000,000 of them, and the get_models API call is rate limited, with no way to ask for the oldest models, we can only sort by last changed, or do a search.
Additional Context
No response
Metadata
Metadata
Assignees
Labels
data setsAcquiring new data sets to catalog or create.Acquiring new data sets to catalog or create.
Type
Projects
Status
No status