Sketching: Draw the UIs or Data Architecture You Want

[Juice10]

What: Provide the agent with a rough sketch or a diagram (even a video walkthrough) and let it generate code from the visual concept.
Why: Easier for non-programmers to specify design changes or new features without having to formulate them in text prompts.
Questions:
Which tools or libraries could interpret sketches or diagrams into structured data for the AI?
How do we ensure that the agent’s generated code truly matches the visual design?
Does anyone have experience with building design-to-code pipelines we can learn from?
Share your experiences or any relevant research/tech that can help bring “sketch-based coding” to life.