Skip to content

Feat: Add AI-powered sound generator HTML widget and backend API #4687

Closed
nafisa404 wants to merge 1 commit intosugarlabs:masterfrom
nafisa404:feat/ai-sound-generator
Closed

Feat: Add AI-powered sound generator HTML widget and backend API #4687
nafisa404 wants to merge 1 commit intosugarlabs:masterfrom
nafisa404:feat/ai-sound-generator

Conversation

@nafisa404
Copy link

@nafisa404 nafisa404 commented May 10, 2025

This PR introduces an AI-powered audio sample generator for Music Blocks as proposed in issue #4540

Features:

  • sample-generator.html: A new widget that lets users upload audio and enter text prompts like "guitar with lion roar"
  • ai-backend/main.py: A FastAPI backend that simulates audio transformation (uses FFmpeg echo effect as a proof of concept)

How it works:

  • The user provides a sound file or records one
  • Adds a creative prompt
  • A modified sound file is generated and returned to the browser for playback

This sets the groundwork for integrating real generative models like DDSP or RAVE in future stages.

Fixes #4538

cc @walterbender @SumitSrivastava @devinulibarri

@github-actions
Copy link
Contributor

✅ All Jest tests passed! This PR is ready to merge.

@nafisa404 nafisa404 force-pushed the feat/ai-sound-generator branch from 9820454 to 07895b3 Compare May 12, 2025 16:54
@github-actions
Copy link
Contributor

✅ All Jest tests passed! This PR is ready to merge.

@github-actions
Copy link
Contributor

This pull request has been open for more than 60 days without any activity. It will be closed in 3 days unless the stale label is removed or commented on.

@github-actions github-actions bot added the Stale label Jul 11, 2025
@github-actions
Copy link
Contributor

Closed pull request due to inactivity for more than 63 days.

@github-actions github-actions bot closed this Jul 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DMP 2025]: AI-powered Debugger for Music Blocks

1 participant