Generic function/class for crawling STAC to product ndjson for pgstac?

[tylere]

The generate.py files of the three demos seem to share a lot of code, interspersed with some hardcoded values. An improvement could be to create a generic function/class that takes a STAC root url, and crawls the STAC links to create an ndjson files for pgstac. How feasible is this?

[vincentsarago]

@tylere I don't see this repo to be really re-used. I don't really plan to re-run the creation of those collections and items files often so I won't spend to much time trying to work on the code it self

[tylere]

Given you don't see this repo being reused, could you suggest alternative workflows/best practices for populating pgstac from existing STAC collections?

[vincentsarago]

well I'm not sure what you mean by workflow. right now the easiest way is to use pypgstac to ingest new collections/items.

This repo was mean mostly to create public example of how to scrape open stac dataset 😅

[tylere]

By workflow I meant scraping a STAC dataset to populate pgstac. I would imagine that this would be a common need.

The examples have certainly been helpful! 😄