Using Pony models with diffusers
Is it necessary for Pony models to directly set the clip skip to 2(-2) or it is already used like this in StableDiffusionXLPipeline? If i do, how can i perform this? I couldn’t find any information on setting clip skip value in diffusers on sdxl models.
2024-09-05T22:27:51Z
Actually, that feature is probably not an SDXL standard, but unique to the A1111 WebUI lineage. It is the de facto standard, though.You can enable it using the community pipeline below.It is also used in the Animagine generation space, for example.huggingface.cowaifu-research-department/long-prompt-weighting-pipeline · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.github.comhuggingface/diffusers/blob/main/examples/community/lpw_stable_diffusion_xl.py## ----------------------------------------------------------
# A SDXL pipeline can take unlimited weighted prompt
#
# Author: Andrew Zhu
# GitHub: https://github.com/xhinker
# Medium: https://medium.com/@xhinker
## -----------------------------------------------------------

import inspect
import os
from typing import Any, Callable, Dict, List, Optional, Tuple, Union

import torch
from PIL import Image
from transformers import (
    CLIPImageProcessor,
    CLIPTextModel,
    CLIPTextModelWithProjection,
    CLIPTokenizer,
    CLIPVisionModelWithProjection,This file has been truncated.show originalhuggingface.coAnimagine XL 3.1 - a Hugging Face Space by cagliostrolabThe most opinionated, anime-themed SDXL modelpipe = pipeline(
        model_name,
        vae=vae,
        torch_dtype=torch.float16,
        custom_pipeline="lpw_stable_diffusion_xl",
        use_safetensors=True,
        add_watermarker=False,
        use_auth_token=HF_TOKEN,
    )
2024-09-06T16:46:46Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.