🔍

experiments with scribble to compositon methods with ControlNet

hand scribbles guide maps / ControlNet Scribble

ControlNet Scribble opens up the feature to compose a render pretty precisely with contour lines. In this example, a simple traced line composition is the guiding base to a quiet destinct result.

traced original photo / hand scribbled ControlNet graphics

Here we have some various renderings with different ControlNet Scribble weighting values – from 0.4 to 0.8 – PROMPT: analog photo of adult aged male 90s sitting on table, realistic skin , hand on cheek, absend dreaming, fixed eyes , white linen dress , dark hair, wild garden in background, , light leak

free hand scribbled maps

Instead of retracing an exisiting image, we can come up with out own compositions. The drawings can be roughly executed, but keep in mind, that each line has an impact to your composition, so keep track with perspective and only highlight the key features you need in the compositon.

freehand drawing of rough image composition for ScribbleNet + raw rendering

Surprisingly, the results are quiet connected to the original scribble. Although, the results are often more glitchy and deformed than without using ControlNet. Although, the renderings are a perfect starting point for a complex composition when refining.PROMPT: sculpture of a minimalistic colorful patterned curvy blobby round inflated creature object wobbly legs, many fat thick puffyand arms, green plain background, diffuse studio lighting, wide angle perspective, wide angle lens, depth of field

multiple conditioned scribbles

With the right scribble, a motif can be guided pretty precise. Although, there is a lot of difficulty when we want to design specific areas of the image exclusively. With color separation we can trigger area limited diffusion rendering quiet precisely. This method needs an advanced ComfyUI workflow that looks like this.

color coded area ScribbleNet

DOWNLOAD WORKFLOW: color_coded_scribble

hand drawn Scribble Map with dedicated red and green channel