🔍

Experiments with deformed, warped self portraiture

Face swap via inpainting with Krita AI + custom LoRa+ IPAdapter
The creation of advanced portraiture that uses deformation or optical distortion comes with quiet some challenges. Basic models, LoRa, controlNet or face swaper modules are foremost trained on regular facial expressions with no surreal deformation.

basic creation with the help of a FLUX LoRa

creation of deformation lora – creation of wide variation on motifs

surreal analog deformed distorted warped bright neon colored under water water colored studio photo like surreal painting of a ugly old upper body portrait of a distorted warped aged old bald casual caucasian aged adult male person with very short three day beard, deformed lens, lens distortion, wet realistic hairy skin with wrinkles and acne, very expressive deformed face , morph with colorful liquid drips and water, oil, god rays, spherical translucent membranes like jellyfish attached to head, colorful, reflective water, oily iridescent liquid, vignette, depth of field, splashes, mirror, colorful plastic trash bags in floral shapes, bubbles, out of focus, film grain, colorful plastic bag bouquet in blurry background, black ink drops in water, dirty glass, lens distortion, broken curvy mirror, pastel bright plastic weird neon color palette, blurry bloom, overexposed, white glossy milk in background, white smooth facial shells, white bordure, white decorative frame, light leaks, film grain, high contrast, colorful plastic bags cables and pipes and foil, medical facial devices made from glossy chrome metal

face swap + inpainting

Current face swapping modules are mostly optimized for low resolution renderings. As we work with very detailed close-ups in this series, we need to train a custom LoRa from images of a specific person, we like to inject. This works ok-ish with built in Inpaint in A1111 or ForgeUI, but seems to work best with KRITA AI + custom LoRa + IPAdapter

Face swap via inpainting with Krita AI + custom LoRa+ IPAdapter