Search Neon and NOAA LiDAR Archives (#72)

* usgs vendor dem pull draft

* transferred usgs dem load modules

* neon vendor dem load draft

* neon regex spatial filter

* added download funcs drafts

* 3dep ept download func

* download funcs for non-neon/usgs

* NOAA cloud-hosted dem parsing

* added and fixed NOAA DEM work :)

* remove pdal funcs

* drafted LPC tile funcs (3dep,neon,noaa)

* finished als tile search and download

* added ept pipeline JSON build option

* added tests and revised vendor_dems.ipynb

* notebook updates

* unblock environment on osx

* rename and simplify notebook, add api docs

* update docs

* adjust tests, minor search logic simplifications

* try to ignore SSL warning

* reduce ci matrix, use pixi action cache

* update lockfile

* try with frozen env

---------

Co-authored-by: Jack-Hayes <[email protected]>

Author: scottyhq

.github/workflows/ci.yml

@@ -40,7 +40,7 @@ jobs:
     strategy:
       fail-fast: false
       matrix:
-        python-version: ["3.10", "3.11", "3.12"]
+        python-version: ["3.11", "3.12"]
         # windows-latest,
         runs-on: [ubuntu-latest, macos-14]
         #include:

.github/workflows/pixi.yml

@@ -17,10 +17,8 @@ jobs:
         with:
           environments: dev
           manifest-path: pyproject.toml
-          cache: false
-          locked: false
-          #cache-write:
-          #  ${{ github.event_name == 'push' && github.ref_name == 'main' }}
+          cache: true
+          frozen: true
 
       # NOTE: https://github.com/prefix-dev/setup-pixi/issues/136
       - name: Ensure Dynamic version

.gitignore

@@ -1,5 +1,6 @@
 *.bak
 notebooks/
+tests/debug.ipynb
 
 # Byte-compiled / optimized / DLL files
 __pycache__/

.pre-commit-config.yaml

@@ -2,8 +2,6 @@ ci:
   autoupdate_commit_msg: "chore: update pre-commit hooks"
   autofix_commit_msg: "style: pre-commit fixes"
 
-exclude: ^.cruft.json|.copier-answers.yml$
-
 repos:
   - repo: https://github.com/adamchainz/blacken-docs
     rev: "1.19.1"

docs/api.rst

@@ -52,8 +52,22 @@ IO
    sliderule.sample_3dep
    xarray.to_dataset
    xarray.open_maxar_browse
+   xarray.load_usgs_dem
+   xarray.load_neon_dem
+   xarray.load_noaa_dem
+   xarray.load_ncalm_dem
    download.download_item
    download.read_href
+   download.build_usgs_ept_pipeline
+   download.download_usgs_dem
+   download.download_neon_dem
+   download.download_noaa_dem
+   download.download_ncalm_dem
+   download.fetch_usgs_lpc_tiles
+   download.fetch_neon_lpc_tiles
+   download.fetch_noaa_lpc_tiles
+   download.fetch_ncalm_lpc_tiles
+
 
 Plot
 ----