Using real material to create basic shapes to work with in the work of generative ai is a quiet empowering way to reclaim creativity in the often abstract work process. In this experimental workflow, we work with clay as base material in combination with a DepthNet (Depth Anything) ControlNet to generate intriguing creatures or objects of any materiality imaginable. In this specific case, we try to animate these results too, using the open source LivePortrait toolkit.
A special focus needs to be set to the creation of human like features like mouth or eyes in relative postitioning. This restraint comes from the fact, that the LivePortrait models are trained on human face deformation and therefore will not detect any face if to far away from human anatomy. ( there is an animal feaured model available but untested ) – A suitable prompt might be here:
textile sculpture of animal inspired creature of a human face portrait, (sheep wolf, fur, fluffy ears,:0.8) made from pastel bright colored textile, black plain background, diffuse lighting, (textile human eyes and human mouth:1.4)
https://turboflip.de/wp-content/uploads/2024/11/00132-2716918894-ezgif-4-7d887f7453.mp4
