You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There is now a portable runner for local beam jobs written natively in Go. This means we don't have to set any python stuff up any more! It also enforces that functions are properly serializable and registered, which makes it better than the old direct runner.
Copy file name to clipboardExpand all lines: experimental/batchmap/README.md
+2-27Lines changed: 2 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -54,40 +54,15 @@ are identified.
54
54
### Setup
55
55
56
56
The map uses Apache Beam to assemble and run a pipeline of tasks to construct the map.
57
-
The following instructions show how to run this code locally using the Python portable runner.
58
-
Comprehensive documentation for setting up a Python environment is beyond the scope of this demo, but instructions can be found at [Beam Python Tips](https://cwiki.apache.org/confluence/display/BEAM/Python+Tips).
59
-
Steps that worked for me using python 3.10.12 on a Debian machine are:
60
-
61
-
```shell
62
-
python3 --version # Confirm 3.10.12
63
-
sudo apt install python3-venv
64
-
65
-
# Create a virtual python env for configuring the runner and deps
66
-
python3 -m venv ~/Virtualenvs/beampy31012
67
-
source~/Virtualenvs/beampy31012/bin/activate
68
-
python3 -m pip install --upgrade pip
69
-
pip install wheel
70
-
pip install apache-beam
71
-
72
-
# Now run the portable runner, and leave it listening for work on 8099
0 commit comments