You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add AI demos, slightly refactor layout of existing ones (#295)
* Add style transfer livebook
* Improve style transfer example, add Whisper, YOLO and Gemini examples
* Bump mix.lock in all mix projects
* Flatten the layout of all demos
* Improve livebooks text
* Improve text of style tranfer and yolo livebooks
* Refactor Whisper demo
Copy file name to clipboardExpand all lines: README.md
+23-8Lines changed: 23 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,26 +4,41 @@ The simplest way to start using Membrane is via [Boombox](https://github.com/mem
4
4
5
5
In the subdirectories of this repository you can find the following examples of using Membrane:
6
6
7
+
### Basics
7
8
8
9
-[simple_element](https://github.com/membraneframework/membrane_demo/tree/master/simple_element) - an example of a simple Membrane's element capable of counting the incoming buffers
9
10
-[simple_pipeline](https://github.com/membraneframework/membrane_demo/tree/master/simple_pipeline) - an example of a Membrane's pipeline playing an mp3 file
11
+
-[messages_source_and_sink](https://github.com/membraneframework/membrane_demo/tree/master/messages_source_and_sink) - send and receive media from the pipeline via Elixir messages
12
+
-[playing_mp3_file](https://github.com/membraneframework/membrane_demo/tree/master/playing_mp3_file) - play an mp3 file in a Livebook cell
13
+
14
+
### Audio
15
+
16
+
-[mix_audio](https://github.com/membraneframework/membrane_demo/tree/master/mix_audio) - script that mixes two audio tracks into a single AAC file
17
+
-[audio_mixer](https://github.com/membraneframework/membrane_demo/tree/master/audio_mixer) - mix a beep sound into background music
18
+
-[soundwave](https://github.com/membraneframework/membrane_demo/tree/master/soundwave) - plot live audio amplitude on a graph
19
+
20
+
### Streaming protocols
21
+
10
22
-[camera_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/camera_to_hls) - a demonstration of capturing camera output and converting it to an HLS stream
11
23
-[camera_to_hls_nerves](https://github.com/membraneframework/membrane_demo/tree/master/camera_to_hls_nerves) - a demonstration of capturing video from a camera module on Raspberry Pi running Nerves and broadcasting it to a browser via HLS
24
+
-[rtmp](https://github.com/membraneframework/membrane_demo/tree/master/rtmp) - send and receive RTMP stream
12
25
-[rtmp_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtmp_to_hls) - receiving RTMP stream and broadcasting it via HLS
13
26
-[rtmp_to_adaptive_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtmp_to_adaptive_hls) - receiving RTMP stream and broadcasting via multi-bitrate adaptive HLS
14
27
-[rtp](https://github.com/membraneframework/membrane_demo/tree/master/rtp) - sending and receiving RTP/SRTP stream
15
28
-[rtp_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtp_to_hls) - receiving RTP stream and broadcasting it via HLS
16
29
-[rtsp_to_hls](https://github.com/membraneframework/membrane_demo/tree/master/rtsp_to_hls) - receiving RTSP stream and converting it to HLS
30
+
-[webrtc_live_view](https://github.com/membraneframework/membrane_demo/tree/master/webrtc_live_view) - send and receive WebRTC streams from a Phoenix LiveView app
31
+
32
+
### AI
17
33
18
-
Also, there are some [Livebook](https://livebook.dev) examples located in [livebooks](https://github.com/membraneframework/membrane_demo/tree/master/livebooks) directory:
34
+
-[openai_realtime_with_membrane_webrtc](https://github.com/membraneframework/membrane_demo/tree/master/openai_realtime_with_membrane_webrtc) - conversation with AI via browser using [OpenAI Realtime API](https://openai.com/index/introducing-the-realtime-api/)
35
+
-[speech_to_text](https://github.com/membraneframework/membrane_demo/tree/master/speech_to_text) - real-time speech recognition using [Whisper](https://github.com/openai/whisper)
36
+
-[style_transfer](https://github.com/membraneframework/membrane_demo/tree/master/style_transfer) - real-time neural style transfer on a camera stream
37
+
-[talk_with_gemini](https://github.com/membraneframework/membrane_demo/tree/master/talk_with_gemini) - low-latency voice conversation with Google's Gemini Live API
38
+
-[whisper](https://github.com/membraneframework/membrane_demo/tree/master/whisper) - real-time audio transcription with OpenAI's Whisper via Bumblebee
39
+
-[yolo](https://github.com/membraneframework/membrane_demo/tree/master/yolo) - real-time object detection on video with YOLO
19
40
20
-
-[openai_realtime_with_membrane_webrtc](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/openai_realtime_with_membrane_webrtc) - conversation with AI via browser using [OpenAI Realtime API](https://openai.com/index/introducing-the-realtime-api/)
21
-
-[speech_to_text](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/speech_to_text) - real-time speech recognition using [Whisper](https://github.com/openai/whisper)
22
-
-[audio_mixer](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/audio_mixer) - mix a beep sound into background music
23
-
-[messages_source_and_sink](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/messages_source_and_sink) - send and receive media from the pipeline via Elixir messages
24
-
-[playing_mp3_file](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/playing_mp3_file) - play an mp3 file in a Livebook cell
25
-
-[rtmp](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/rtmp) - send and receive RTMP stream
26
-
-[soundwave](https://github.com/membraneframework/membrane_demo/tree/master/livebooks/soundwave) - plot live audio amplitude on a graph
41
+
Many of the demos use [Livebook](https://livebook.dev) - install it to run them.
0 commit comments