Skip to content

Commit fa4b020

Browse files
authored
Add AI demos, slightly refactor layout of existing ones (#295)
* Add style transfer livebook * Improve style transfer example, add Whisper, YOLO and Gemini examples * Bump mix.lock in all mix projects * Flatten the layout of all demos * Improve livebooks text * Improve text of style tranfer and yolo livebooks * Refactor Whisper demo
1 parent b14b20d commit fa4b020

42 files changed

Lines changed: 1185 additions & 268 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

README.md

Lines changed: 23 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -4,26 +4,41 @@ The simplest way to start using Membrane is via [Boombox](https://github.com/mem
44

55
In the subdirectories of this repository you can find the following examples of using Membrane:
66

7+
### Basics
78

89
- [simple_element](https://github.com/membraneframework/membrane_demo/tree/master/simple_element) - an example of a simple Membrane's element capable of counting the incoming buffers
910
- [simple_pipeline](https://github.com/membraneframework/membrane_demo/tree/master/simple_pipeline) - an example of a Membrane's pipeline playing an mp3 file
11+
- [messages_source_and_sink](https://github.com/membraneframework/membrane_demo/tree/master/messages_source_and_sink) - send and receive media from the pipeline via Elixir messages
12+
- [playing_mp3_file](https://github.com/membraneframework/membrane_demo/tree/master/playing_mp3_file) - play an mp3 file in a Livebook cell
13+
14+
### Audio
15+
16+
- [mix_audio](https://github.com/membraneframework/membrane_demo/tree/master/mix_audio) - script that mixes two audio tracks into a single AAC file
17+
- [audio_mixer](https://github.com/membraneframework/membrane_demo/tree/master/audio_mixer) - mix a beep sound into background music
18+
- [soundwave](https://github.com/membraneframework/membrane_demo/tree/master/soundwave) - plot live audio amplitude on a graph
19+
20+
### Streaming protocols
21+
1022
- [camera_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/camera_to_hls) - a demonstration of capturing camera output and converting it to an HLS stream
1123
- [camera_to_hls_nerves](https://github.com/membraneframework/membrane_demo/tree/master/camera_to_hls_nerves) - a demonstration of capturing video from a camera module on Raspberry Pi running Nerves and broadcasting it to a browser via HLS
24+
- [rtmp](https://github.com/membraneframework/membrane_demo/tree/master/rtmp) - send and receive RTMP stream
1225
- [rtmp_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtmp_to_hls) - receiving RTMP stream and broadcasting it via HLS
1326
- [rtmp_to_adaptive_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtmp_to_adaptive_hls) - receiving RTMP stream and broadcasting via multi-bitrate adaptive HLS
1427
- [rtp](https://github.com/membraneframework/membrane_demo/tree/master/rtp) - sending and receiving RTP/SRTP stream
1528
- [rtp_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtp_to_hls) - receiving RTP stream and broadcasting it via HLS
1629
- [rtsp_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtsp_to_hls) - receiving RTSP stream and converting it to HLS
30+
- [webrtc_live_view](https://github.com/membraneframework/membrane_demo/tree/master/webrtc_live_view) - send and receive WebRTC streams from a Phoenix LiveView app
31+
32+
### AI
1733

18-
Also, there are some [Livebook](https://livebook.dev) examples located in [livebooks](https://github.com/membraneframework/membrane_demo/tree/master/livebooks) directory:
34+
- [openai_realtime_with_membrane_webrtc](https://github.com/membraneframework/membrane_demo/tree/master/openai_realtime_with_membrane_webrtc) - conversation with AI via browser using [OpenAI Realtime API](https://openai.com/index/introducing-the-realtime-api/)
35+
- [speech_to_text](https://github.com/membraneframework/membrane_demo/tree/master/speech_to_text) - real-time speech recognition using [Whisper](https://github.com/openai/whisper)
36+
- [style_transfer](https://github.com/membraneframework/membrane_demo/tree/master/style_transfer) - real-time neural style transfer on a camera stream
37+
- [talk_with_gemini](https://github.com/membraneframework/membrane_demo/tree/master/talk_with_gemini) - low-latency voice conversation with Google's Gemini Live API
38+
- [whisper](https://github.com/membraneframework/membrane_demo/tree/master/whisper) - real-time audio transcription with OpenAI's Whisper via Bumblebee
39+
- [yolo](https://github.com/membraneframework/membrane_demo/tree/master/yolo) - real-time object detection on video with YOLO
1940

20-
- [openai_realtime_with_membrane_webrtc](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/openai_realtime_with_membrane_webrtc) - conversation with AI via browser using [OpenAI Realtime API](https://openai.com/index/introducing-the-realtime-api/)
21-
- [speech_to_text](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/speech_to_text) - real-time speech recognition using [Whisper](https://github.com/openai/whisper)
22-
- [audio_mixer](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/audio_mixer) - mix a beep sound into background music
23-
- [messages_source_and_sink](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/messages_source_and_sink) - send and receive media from the pipeline via Elixir messages
24-
- [playing_mp3_file](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/playing_mp3_file) - play an mp3 file in a Livebook cell
25-
- [rtmp](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/rtmp) - send and receive RTMP stream
26-
- [soundwave](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/soundwave) - plot live audio amplitude on a graph
41+
Many of the demos use [Livebook](https://livebook.dev) - install it to run them.
2742

2843
## Authors
2944

File renamed without changes.
File renamed without changes.

0 commit comments

Comments
 (0)