awesome-layout-to-image

multi-layout to image

Abbreviation	Type	Title	Publication	Paper	Code
ControlNet	layout,(text)->image	Adding Conditional Control to Text-to-Image Diffusion Models	ICCV'2023	ControlNet	link
T2I-Adapter	layout,(text)->image	T2I-Adapter: Learning Adapters to Dig Out More Controllable Ability for Text-to-Image Diffusion Models	AAAI'2024	T2I-Adapter	link
Uni-ControlNet	layout,(text)->image	Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models	NIPS'2023	Uni-ControlNet	link
CRS-Diff	layout,(text)->image	CRS-Diff: Controllable Generative Remote Sensing Foundation Modeln	arXiv'2024	CRS-Diff	link
GeoSynth	layout,(text)->image	GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis	CVPRW'2024	GeoSynth	link
Ctrl-X	layout,(text)->image	Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance	arXiv'2024	Ctrl-X	link

mask to image

Abbreviation	Type	Title	Publication	Paper	Code
SPADE	mask->image	Semantic Image Synthesis with Spatially-Adaptive Normalization	CVPR'2019	SPADE	link
OASIS	mask->image	You Only Need Adversarial Supervision for Semantic Image Synthesis	ICLR'2021	OASIS	link
SDM	mask->image	Semantic Image Synthesis via Diffusion Models	arXiv'2022	SDM	link
/	mask->image	Mask Conditional Synthetic Satellite Imagery	ICLRW'2023	paper	link
FreestyleNet	mask,text->image	Freestyle Layout-to-Image Synthesis	CVPR'2023	FreestyleNet	link
Changen	mask->image	Scalable Multi-Temporal Remote Sensing Change Data Generation via Simulating Stochastic Change Process	ICCV'2023	Changen	link
Label Freedom	->image,mask	Label Freedom: Stable Diffusion for Remote Sensing Image Semantic Segmentation Data Generation	BigData'2023	Label Freedom	/
DP-SIMS	mask->image	Unlocking Pre-trained Image Backbones for Semantic Image Synthesis	arXiv'2023	DP-SIMS	/
Dataset Diffusion	text->image,mask	Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentation	NIPS'2023	Dataset Diffusion	link
FreeMask	mask,text->image	FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Models	NIPS'2023	FreeMask	link
ALDM	mask,(text)->image	Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrive	ICLR'2024	ALDM	link
SatSynth	->image,mask	SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation	CVPR'2024	SatSynth	/
PLACE	mask,text->image	PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesis	CVPR'2024	PLACE	link
SCP-Diff	mask,text->image	SCP-Diff: Photo-Realistic Semantic Image Synthesis with Spatial-Categorical joint priors	arXiv'2024	SCP-Diff	link
ChangeAnywhere	mask->image	ChangeAnywhere: Sample Generation for Remote Sensing Change Detection via Semantic Latent Diffusion Model	arXiv'2024	ChangeAnywhere	link
Changen2	mask->image	Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model	arXiv'2024	Changen2	/

bbox to image

Abbreviation	Type	Title	Publication	Paper	Code
ReCo	layout,region caption->image	ReCo: Region-Controlled Text-to-Image Generation	CVPR'2023	ReCo	link
SSMG	layout,region caption->image	SSMG: Spatial-Semantic Map Guided Diffusion Model for Free-Form Layout-to-Image Generation	AAAI'2024	SSMG
LayoutDiff	layout,instance class->image	LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation	CVPR'2023	LayoutDiff	link
LAW-Diffusion	layout,instance class->image	LAW-Diffusion: Complex Scene Generation by Diffusion with Layouts	ICCV'2023	LAW-Diffusion

key point to image

Abbreviation	Title	Publication	Paper	Code

...