Fig 1: TPF-JAM-TOOL in action.
TPF-JAM-TOOL is a low-latency 'jamming tool' that connects sixteen different jamming partners/locations. (Mac only)
TPF-JAM-TOOL further develops the previous tools 'tpf-tools' and 'TPF-JAM-BASIC'. Reaper.fm is one of the most widely used digital audio workstations (DAW) today. Reaper, as a DAW, is our choice because most of the parameters in Reaper can be operated via scripts (LuaScript) and are available for retrieval, as well as having early audio routing. The idea behind the TPF-JAM-TOOL is to provide a very easy-to-use bundle with various possibilities. In connection with the SNSF research project 'spatial-dis-continuities-in-telematic-performances', many features have been incorporated into this tool.
Over the years, we spent many hours communicating over Zoom as a team of artists and researchers, which always tired us out quickly from an acoustic point of view. After experimenting with Ambisonics and Binaural rendering, many of us became less tired because a more natural hearing sensation set in, especially in music making.
This was the primary motivation to integrate the 3D audio research 'Ambisonics at ICST' into the telematic applications in the spatial-discontinuities-in-telematic-performances project. The tools are freely available, and while the installation may take some time, it's a worthwhile investment. The TPF-Client application handles firewall and IT settings, allowing you to focus on immediately connecting with other musicians and starting to jam. The digital audio workstation "Reaper 7.16"(the newest) is your digital mixing console. You can mix the incoming signals in a virtual room with Reaper and the pre-installed third-party plugins. Of course, the mix can also be recorded directly in Reaper, providing an instant recording of your jamming session.
And now, let's jam...
- Low-latency bidirectional telematic jamming over Lan
- Two Inputs (Mic/Inst) sending to max 16-Destinations/Locations
- Receiving max. 16 locations
- Placement in 3D audio (binaural)
- Streaming a binaural Mix (2ch) over OBS
- Head tracking (Headphones)
- Recording
- Playback of audio from the DAW
- Rec/Play from external sources (e.g., Ableton)
- Play Video from the DAW
- The tools are freely available
You can download the TPF-JAM-TOOL here: TPF-JAM-TOOL
TPF-JAM-TOOL is for testing and is still under development! Please read the installation instructions!
Make sure to have all these Applications pre-installed:
- TPF-JAM-TOOL
- TPF-Client_v2.0+ (latest)
- ICST Ambisonics Plugins (Please install the Pre-release v3.0.0.3)
- IEM-Plugin-Suite
- FaceMotionTracker
- Reaper.app
- BlackHole is a modern macOS virtual audio loopback driver that allows applications to pass audio to other applications with zero additional latency. Donate $10.
After downloading, open the dmg file and drag the Reaper.app into the folder '/Applications/TPF-JAM-TOOL'. Then, open the Reaper.app with a Ctrl-click or right-click.
You have completed all pre-installations and are up to date.
--> Restart Computer!
- First, set up your Audio Interface and Hardware components, e.g.
- Mic (CH1)
- Instrument (Keyboard) (CH2)
- Make sure that your hardware works correctly with your Mac/PC
- Create an Aggregate (Mac) and name it as shown in the following picture. The correct order of components is crucial. (for Windows take Virtual cable (Donate $)
- You get all the needed information, like the server address, room, and link to Livelab, by mail invitation from Bandleader.
- Open Reaper, then choose "Setting" -> "Device" and select your 'Aggregate TPF-JAM-TOOL'.
- The left toolbar of the Reaper template contains all the necessary functions for a telematic connection.
- Press the button 'tpf-client on'
- In 'tpf-client,' go to Settings and add your and the .
- Before connecting to the server, check your inputs in Reaper and unmute your local inputs 1 and 2 (the channels in tpf-client are flickering green)
- To connect to the server, click the top left square in the tpf-client. If connected, it will turn blue.
- One by one, all fellow musicians/locations will appear. You can connect by clicking the square on the left. You should now hear them all.
- Click 'LiveLab' in the left toolbar of Reaper, and your main browser will open. Type in the LiveLab URL you received from the bandleader. In the settings of LiveLab, choose 'no audio. '
- then click 'start'. You should now be connected by video. (Set Google-Chrome.app as your main Browser)
Your audio should be connected to the TPF client and all other musicians/locations. You are connected to video via LiveLab in the Chrome browser. So, happy jamming...
- Click 'tpf-client off'. I just wanted to remind you to try to disconnect all connections before.
- Press FPHD and LiveLab off
- Close your Reaper session
For more detailed information, visit the Wiki https://github.com/joambi/tpf-jam-tool/wiki -->, which is still in progress!
For any bug report or suggestion, please open an issue here.
- REAPER (DAW)
- IEM Plugin Suite https://plugins.iem.at/
- ICST Ambisonics Plugins https://github.com/schweizerweb/icst-ambisonics-plugins/wiki
- TPF-Client 2.0+ https://github.com/zhdk/tpf-client
- NX Head Tracker Waves https://www.waves.com/hardware/nx-head-tracker
- USB Head Tracker https://supperware.co.uk/headtracker-overview
- nvsonic https://github.com/trsonic/nvsonic-head-tracker
- RC HeadTracker https://github.com/dlktdr/HeadTracker
- OpenTrack (win/linux)
- SAKHeadTracker https://spatialaudiokit.github.io/headtracker/
Reaper is not free, but you can evaluate it for 60 days with full functionality and no strings attached. All license purchases are final. If you own multiple computers, you may install the same license key on them if you only use REAPER on one computer at a time. Purchasing Reaper We have to thank all these wonderful resources:
- SWS/S&M EXTENSION
- ReaPack Please donate them when you are happy with all these tools!
Johannes Schuett / Roman Haefeli / Matthias Ziegler / Patrick Mueller
GPL 3.0 (see LICENSE.txt)
©2024 ICST/ZHdK Switzerland