Skip to content

Commit 83b9884

Browse files
authored
Update master with new experiments
2 parents 59b231b + 5e0a36e commit 83b9884

114 files changed

Lines changed: 27191 additions & 377 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.gitignore

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
1+
.ipynb_checkpoints
12
*.so
23
*.o
34
*.tar.gz
@@ -7,4 +8,5 @@
78
Dockerfile*
89
*.log
910
__pycache__/
10-
*.txt
11+
*.txt
12+
*.zarr

.gitmodules

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +0,0 @@
1-
[submodule "dasf-core"]
2-
path = dasf-core
3-
url = git@github.com:discovery-unicamp/dasf-core.git
4-
[submodule "dasf-seismic"]
5-
path = dasf-seismic
6-
url = git@github.com:discovery-unicamp/dasf-seismic.git

README.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -99,3 +99,18 @@ python run_experiment_on_scope.py --cpu --gpu --baseline --tvm 1 --jax --sample
9999
```
100100

101101
The CLI command presented above runs the CPU (`--cpu`) and GPU (`--gpu`) operatos, for the baselines (`--baseline`), JAX (`--jax`) and TVM operators from Build 1 of the current scope (`--tvm 1`). It will use the sample 1 from the dataset, repeat the measuments 5 times and set OMP_NUM_THREADS to 6. A different Experiment Id can be selected using the `experiment-id` flag.
102+
103+
104+
### Running memory profiling experiments
105+
106+
Only MemRay and NsightSystems are installed in the base image, to run `mprof` and `/usr/bin/time` experiments install them with:
107+
108+
```
109+
pip install memory_profiler
110+
apt install time
111+
```
112+
113+
## Third Party software
114+
This project includes code based on the following projects:
115+
- [DASF Seismic](https://github.com/discovery-unicamp/dasf-seismic): MIT License
116+
- [d2geo](https://github.com/dudley-fitzgerald/d2geo): GPL-3.0 license

aux_repo/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
THIS IS BAD! DON'T DO THIS!!!!!
2+
I HAD to create a copy of the multiprocessing module to remove the restriction that Daemon processes can't create child processes, otherwise it would be impossible to run torch.compile operators inside a Dask CUDA worker. =(
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
#
2+
# Package analogous to 'threading.py' but using processes
3+
#
4+
# multiprocessing/__init__.py
5+
#
6+
# This package is intended to duplicate the functionality (and much of
7+
# the API) of threading.py but uses processes instead of threads. A
8+
# subpackage 'multiprocessing.dummy' has the same API but is a simple
9+
# wrapper for 'threading'.
10+
#
11+
# Copyright (c) 2006-2008, R Oudkerk
12+
# Licensed to PSF under a Contributor Agreement.
13+
#
14+
15+
import sys
16+
from . import context
17+
18+
#
19+
# Copy stuff from default context
20+
#
21+
22+
__all__ = [x for x in dir(context._default_context) if not x.startswith('_')]
23+
globals().update((name, getattr(context._default_context, name)) for name in __all__)
24+
25+
#
26+
# XXX These should not really be documented or public.
27+
#
28+
29+
SUBDEBUG = 5
30+
SUBWARNING = 25
31+
32+
#
33+
# Alias for main module -- will be reset by bootstrapping child processes
34+
#
35+
36+
if '__main__' in sys.modules:
37+
sys.modules['__mp_main__'] = sys.modules['__main__']

0 commit comments

Comments
 (0)