Full Body Consistency

[Ambratolm]

Problematic

Is there a good or decent way to achieve full body consistency ? Not only face consistency.
I know it maybe hard or impossible for the moment, but any thoughts or ideas on the subject would be appreciated.

Ultimate objectif:
Given a character defined with an image or more of his full body (face, body shape, and cloths), incorporate him in a scene, either via a simple text prompt or via image prompt with a target scene image for body swapping.

For example, we want this guy here :

🖼 Source body image

to be fully (body, face, cloths)...

In this target image:

🖼 Target scene image

or in an image generated by this prompt:

strong 1man, jumping up, shooting cars, pointing guns on cops, epic city background with fire and destruction.

---

Attempt: Consistent Character Guide (Imperfect)

1. Character Reference Sheet Source

Find a good 3D character reference sheet source image online.

• 🔎 Some Search Links:

  • 3d model reference sheet
  • 3d mannequin reference sheet
  • 3d man reference sheet
  • 3d woman reference sheet

• ☑️ Example:

  🖼 Character reference sheet source image

  

2. Character Reference Sheet

Generate your character sheet in Fooocus with a text prompt and an image prompt.

• Text Prompt:

  character turnaround, multiple views, [Body], [Style], [Cloths]
  

  • Replace [Body] with your description of the character's body and face.
  • Replace [Style] with your description of the additional art style.
  • Replace [Cloths] with your description of the character's clothing.

• Image Prompt:

  • Image: Character Reference Sheet Source
  • Type: PyraCanny
  • StopAt: 1
  • Weight: <= 0.5 (~ 0.35 Recommended)

• ☑️ Example:

  character turnaround, multiple views, red haired 1girl, 6 years old, short, blue eyes, Pixar styled character, black t-shirt, green pants, black shoes
  

  • Body: red haired 1girl, 6 years old, short, blue eyes
  • Cloths: black t-shirt, green pants, black shoes
  • Style: pixar styled character
  🖼 Character reference sheet image

  

3. Character Reference Sheet without Background

Remove the background of your character reference sheet image and replace it with transparence, using any image editting tool that allows you to do it easily in one click, like Adobe Express.

• Example:

  🖼 Character reference sheet image wihout background

  

4. Character Scene

Generate a scene with your character in Fooocus with a text prompt and 4 images prompt.

• Text Prompt:

  [Body], [Style], [Pose], [Cloths], [Background]
  

  • Replace [Body] with the same as before.
  • Replace [Style] with the same as before.
  • 🆕 Replace [Pose] with your description of the character's physical pose and facial expression.
  • Replace [Cloths] with the same as before.
  • 🆕 Replace [Background] with your description of the scene's background.

• Image Prompts:

  For each empty image slot (4 max):

  • Image: Character Reference Sheet without Background.
    • Use the Edit tool to crop a pose. Use a different pose in each slot.
  • Type: ImagePrompt
  • StopAt: 0.5 (Default)
  • Weight: 0.6 (Default)

• ☑️ Example:

  red haired 1girl, 6 years old, short, blue eyes, Pixar styled character, dynamic running pose, full sprint, laughing face, black t-shirt, green pants, black shoes, desert background
  

  🖼 Character scene images

  
  
  
  

[ayushyadav547]

i followed the whole process, yet i am getting a single image of the character