Simpsons diffusion

*Stable Diffusion fine tuned on images related to "The Simpsons"

If you want more details on how to generate your own blip cpationed dataset see this colab

Training was done using a slightly modified version of Hugging-Face's text to image training example script

About

Put in a text prompt and generate cartoony/simpsony images

A beautiful hungry demon girl, John Philip Falter, Very detailed painting, Mark Ryden

Gal Gadot, cartoon

More examples

The examples folder contains a few images generated by this model's ckpt file using stable-diffusion-webui which means their EXIF info contain the parameter used to generate them

Sample code

from diffusers import StableDiffusionPipeline, LMSDiscreteScheduler
import torch

# this will substitute the default PNDM scheduler for K-LMS  
lms = LMSDiscreteScheduler(
    beta_start=0.00085, 
    beta_end=0.012, 
    beta_schedule="scaled_linear"
)

guidance_scale=9
seed=7777
steps=100

model_id = "Norod78/sd-simpsons-model"
pipe = StableDiffusionPipeline.from_pretrained(model_id, scheduler=lms, torch_dtype=torch.float16)
pipe.to("cuda")

prompt = "a photo of an astronaut riding a horse on mars"
image = pipe(prompt).images[0]  
    
image.save("astronaut_rides_horse.png")

Dataset and Training

Finetuned for 10,000 iterations upon Runway ML's Stable-Diffusion v1.5 on BLIP captioned Simpsons images using 1xA5000 GPU on my home desktop computer

Trained by @Norod78