🔍

Fun with Stable Diffusion Scribble ControlNet

STROKE WIDTH & OVERWEIGHTED SCRIBBLE CONTROLNET

The stroke width works as some kind of area of interest for the neuronal network. The most prominent prompt elements are projected to the contours. All examples run with controlnet weight 1.2 same prompt as below.

((( curvy glossy bubbly water streamlet flowing weightless made from molten white glossy porcelain frozen within fluffy surreal rough mossy forest floor and natural water pool frozen like white bubbly paste, dense wild wet dirty rough distressed natural forest floor in background cloudy foggy curvy very surreal with rim lights, complementary bright unsaturated pastel color palette , surreal painting rendering style, high contrast )))

contronet scribble – weight 1.2 & strokewidth 12px
contronet scribble – weight 1.2 & strokewidth 22px
contronet scribble – weight 1.2 & strokewidth 42px
contronet scribble – weight 1.2 & strokewidth 42px & basic typo drawing
contronet scribble – weight 1.2 & strokewidth various
contronet scribble – weight 1.1 & stroke transparency

OVER WEIGHTENING OF SCRIBBLE CONTROLNET

The weightening of the controlnet in combination with simple drawing can have significant effect to the image! Especially when running over 1.0!

((( curvy glossy bubbly water streamlet flowing weightless made from molten white glossy porcelain frozen within fluffy surreal rough mossy forest floor and natural water pool frozen like white bubbly paste, dense wild wet dirty rough distressed natural forest floor in background cloudy foggy curvy very surreal with rim lights, complementary bright unsaturated pastel color palette , surreal painting rendering style, high contrast )))

contronet scribble – weight 0.3
contronet scribble – weight 0.75
contronet scribble – weight 0.9
contronet scribble – weight 1.3
contronet scribble – weight 1.5

SUPERSKETCH

SUPERSKETCH is a quick prototype, that makes use of the Stable Diffusion/A1111/ControlNet Pipeline using the Scribble models to render proper images. The user can draw simple black and white sketches with can be augmented with proper postive and negative prompts. This prototype is currently in testing and development for Android.

(( realistic detail photo of white ancient cyborg chinese traditional synthesizer, studio light, contrast, high key, detailed tiny displays with illuminated abstract graphics,case all made from white glossy porcelain with chinese blue patterns, knobs made from wood, fine straight detail, chrome edges, illuminated leds, dirty used wet orthographic perspective ))

even with minimalistic sketched guidelines in combination with a proper prompt, we can have instant good results
more intriguing sketching leads to more detailed renderings
with change of prompt balance and the adding of more curvy forms, the synthesizer can be transformed to traditional chinese porcelain

grayscale scribble to form

This grayscale map is not really recognized by the ai, but reinterpreted – so there are quiet some interessting results here with this prompt: ((detail of dirty fur and hair wet )) and wet skin, realistic, DOF, pattern collage ( some negative prompting needed to avoid faces in each render )

grayscale to scrible controlnet

monochrome scribble to form

ControlNet’s scribble functions makes it possible to generate insane detailed graphics from plain simple scribbles. This series uses this prompt in addition: ((detail of many feathers and fur wet and dirty )) and wet skin, realistic, DOF, pattern collage

simple translation from scribble to form