Skip to content

Commit

Permalink
Add links to Xarray integration and blog post to docs (#243)
Browse files Browse the repository at this point in the history
  • Loading branch information
tomwhite authored Jul 3, 2023
1 parent fd32152 commit 7c6f85a
Show file tree
Hide file tree
Showing 3 changed files with 8 additions and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,6 @@ Cubed is a distributed N-dimensional array library implemented in Python using b
- Follows [Dask Array](https://docs.dask.org/en/stable/array.html)'s chunked array API (`map_blocks`, `rechunk`, `apply_gufunc`, etc)
- [Zarr](https://zarr.readthedocs.io/en/stable/) for persistent and intermediate storage
- Multiple serverless runtimes: Python (in-process), [Lithops](https://lithops-cloud.github.io/), [Modal](https://modal.com/), [Apache Beam](https://beam.apache.org/)
- Integration with [Xarray](https://xarray.dev/) via [cubed-xarray](https://github.com/xarray-contrib/cubed-xarray)

[Documentation](https://tomwhite.github.io/cubed)
1 change: 1 addition & 0 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ Cubed is a distributed N-dimensional array library implemented in Python using b
- Follows [Dask Array](https://docs.dask.org/en/stable/array.html)'s chunked array API (`map_blocks`, `rechunk`, etc)
- [Zarr](https://zarr.readthedocs.io/en/stable/) for storage
- Multiple serverless runtimes: Python (in-process), [Lithops](https://lithops-cloud.github.io/), [Modal](https://modal.com/), [Apache Beam](https://beam.apache.org/)
- Integration with [Xarray](https://xarray.dev/) via [cubed-xarray](https://github.com/xarray-contrib/cubed-xarray)

## Documentation

Expand Down
6 changes: 6 additions & 0 deletions docs/related-projects.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,12 @@ Dask only has a single distributed runtime, Dask Distributed, whereas Cubed has

The core operations and array API layers in Cubed are heavily influenced by Dask Array - in both naming, as well as implementation (Cubed uses Dask Array for some chunking utilities).

## Xarray

You can use Cubed with Xarray using the [cubed-xarray](https://github.com/xarray-contrib/cubed-xarray) package.

Read more about the integration in [Cubed: Bounded-memory serverless array processing in xarray](https://xarray.dev/blog/cubed-xarray).

## Previous work

This project is a continuation of a similar project I worked on, called [Zappy](https://github.com/lasersonlab/zappy/tree/master/zappy). What's changed in the intervening three years? Rechunker was created (I wasn't so concerned with memory when working on Zappy). The Python Array API standard has been created, which makes implementing a new array API less daunting than implementing the NumPy API. And I have a better understanding of Dask, and the fundamental nature of the blockwise operation.

0 comments on commit 7c6f85a

Please sign in to comment.