Skip to content

Commit d9e0ea2

Browse files
qinxuyewjsi
authored andcommitted
DataFrame initial support (#173)
* initialize dataframe * adjust inheritance for mars/core and mars/serialize, serialize no longer inherit from mars/core, and SerializableWithKey and AttributeAsDictKey has been moved to mars/core * move Chunk and ChunkData to mars/core * refine import and comment * add dataframe.proto * add TilesableData, make TensorData inherit from it * add SliceField * add TilesableOperandMixin * add new_chunks in the TilesableData, add TensorChunkData inherited from ChunkData and TensorChunk inherited from Chunk * add new_entities * add IndexChunkData * add chunk type of index, series and dataframe * add DataFrameOperandMixin * add DataFrame datasource * sync rough_bytes * add decide_chunk_sizes for dataframe * support tokenize type relative to pandas * finish expression part of from_pandas * move executor to top level, add dataframe execute support * support serialize dataframe for graph * refine ut * fix according to codacy * remove unused code to increase coverage
1 parent a1a4e41 commit d9e0ea2

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

72 files changed

+3715
-1138
lines changed

.travis.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -65,10 +65,10 @@ before_script:
6565
script:
6666
mkdir -p build &&
6767
pytest --cov-report= --cov-config .coveragerc-tensor --cov=mars --timeout=1500 -W ignore::PendingDeprecationWarning
68-
mars/tensor mars/web &&
68+
mars/tensor mars/dataframe mars/web &&
6969
mv .coverage build/.coverage.tensor.file &&
7070
pytest --cov-report= --cov-config .coveragerc --cov=mars --timeout=1500 --forked -W ignore::PendingDeprecationWarning
71-
--ignore mars/tensor mars &&
71+
--ignore mars/tensor --ignore mars/dataframe mars &&
7272
mv .coverage build/.coverage.main.file &&
7373
coverage combine build/ && coverage report --fail-under=85 &&
7474
export DEFAULT_VENV=$VIRTUAL_ENV &&

0 commit comments

Comments
 (0)