designing with self trained minimalistic LORA models
👁 218 | Tristan Schulze lately updated this on November 6, 2023
20
minimalistic dataset made from handdrawn abstract drawings
With KOHYA, we have an open source tool, to train our own LORA models on our home machines. This can be done with even a very small amount of image data. This experiment is a proof of concept to show the limitations of such minimal AI models. You can try it on your own if you download the pretty small LORA: trx_one
(hyper detailed breaking ocean waves, gusty sea :1.2) , trx_one thin curved black ink strokes, (white plain paper background:1.2), high contrast, sharp, diffuse bright lighting, (blur, blurry:1.1), dots
hand drawn minimal training set with two colored pen drawingsdrawing a complex motif – pen drawing – with strong LORA influencegenerating a complex embroidery with mid LORA impact
handdrawn color panels as training datasetusing the painterly LORA to guide the img2img overworkingusing the painterly LORA to guide different forms like textile cablesusing the LORA to guide form finding process – here to set cables in a compositionusing the LORA to guide form finding process – here to set textile cables in a composition
training with plain photography
minimal wild wood training set in 512×512These slide show the variation of LORA strength appied to a fixed seedusing this wood structured LORA to modify water is quiet inerestingwith more strength, we can create more painterly effects
sources and help
Great simple guide how to install Kohya on your machine!
Good guide how to use Kohya to train your model!
(SPOILER: Check the structure of your training folder! )