svjack's picture
Update README.md
b4832c3 verified
|
raw
history blame
8.78 kB
# LoRA Fine-tuned Kontext Model for Artistic Style Transfer
This repository provides a **LoRA (Low-Rank Adaptation)** fine-tuned variant of the Kontext image consistency model, optimized for transforming images into 22 distinct artistic styles while preserving content consistency.
---
## 🎨 Supported Art Styles
- can refer on https://github.com/showlab/OmniConsistency
| Style Category | Example Prompt | Visual Characteristics |
|----------------|----------------|------------------------|
| **3D Chibi Style** | `transform it into 3D Chibi style` | Exaggerated cute proportions with three-dimensional rendering and soft shading |
| **American Cartoon Style** | `transform it into American Cartoon style` | Bold outlines, vibrant colors, and exaggerated expressions typical of Western animation |
| **Chinese Ink Style** | `transform it into Chinese Ink style` | Flowing brushstrokes, monochromatic tones, and traditional shan shui aesthetics |
| **Clay Toy Style** | `transform it into Clay Toy style` | Matte textures with visible fingerprints and soft plasticine-like appearance |
| **Fabric Style** | `transform it into Fabric style` | Woven textile appearance with stitch details and cloth-like folds |
| **Ghibli Style** | `transform it into Ghibli style` | Soft watercolor-like backgrounds, expressive eyes, and whimsical Studio Ghibli aesthetic |
| **Irasutoya Style** | `transform it into Irasutoya style` | Clean vector graphics with flat colors and simple shapes (Japanese clipart style) |
| **Jojo Style** | `transform it into Jojo style` | Dynamic "bizarre" poses, exaggerated muscles, and dramatic manga shading |
| **LEGO Style** | `transform it into LEGO style` | Blocky construction with cylindrical hands and studded surfaces |
| **Line Style** | `transform it into Line style` | Minimalist continuous-line drawings with negative space emphasis |
| **Macaron Style** | `transform it into Macaron style` | Pastel colors with soft gradients and candy-like textures |
| **Oil Painting Style** | `transform it into Oil Painting style` | Visible impasto brushstrokes and rich pigment textures |
| **Origami Style** | `transform it into Origami style` | Geometric folded paper appearance with crisp edges |
| **Paper Cutting Style** | `transform it into Paper Cutting style` | Silhouette art with intricate negative space patterns |
| **Picasso Style** | `transform it into Picasso style` | Cubist fragmentation and abstract facial rearrangements |
| **Pixel Style** | `transform it into Pixel style` | 8-bit/16-bit retro game aesthetic with visible square pixels |
| **Poly Style** | `transform it into Poly style` | Low-polygon 3D models with flat-shaded triangular facets |
| **Pop Art Style** | `transform it into Pop Art style` | Ben-Day dots, bold colors, and high-contrast comic book styling |
| **Rick Morty Style** | `transform it into Rick Morty style` | Squiggly lines, grotesque proportions, and adult swim animation style |
| **Snoopy Style** | `transform it into Snoopy style` | Simple black-and-white comic strip aesthetic with round features |
| **Vector Style** | `transform it into Vector style` | Clean geometric shapes with gradient fills and sharp edges |
| **Van Gogh Style** | `transform it into Van Gogh style` | Swirling brushwork, thick impasto, and post-impressionist color fields |
---
## 🖼️ Style Transformation Examples
### Ghibli Style Transformation (爱豆翔)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/YSqHEgoMLoCWHB9r9rbL7.jpeg) | ![Ghibli](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/eryeU7hvA7gvkw1134gYU.jpeg) |
| *Prompt*: `transform it into Ghibli style` | *Characteristics*: Soft watercolor textures, expressive eyes |
### LEGO Style Transformation (吃冰淇凌的翔)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/vFOwrmTci1jmeoOA-NOw8.png) | ![LEGO](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/F6v_iyDz4MpGRCj6HQwVH.jpeg) |
| *Prompt*: `transform it into LEGO style` | *Characteristics*: Blocky construction with cylindrical hands and studded surfaces |
### 3D Chibi Style Transformation (包拯)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/1tuBpVvprYA3LaZl10gcN.jpeg) | ![Chibi](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/KAPjcbO4FVvCnPf4Ny3UC.png) |
| *Prompt*: `transform it into 3D Chibi style` | *Characteristics*: Exaggerated cute proportions, 3D rendering |
### Oil Painting Style Transformation (拿破仑)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/fdrT28mSr5OsxvV04pXZ8.jpeg) | ![Oil Painting](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/8qCwpJpyDpScGpY8eMXno.png) |
| *Prompt*: `transform it into Oil Painting style` | *Characteristics*: Visible brushstrokes, impasto texture |
### Jojo Style Transformation (叶卡捷琳娜)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/hrw-jnm4cDoIOLr5DN0V-.jpeg) | ![Jojo](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/O09TlMIMNDcU7HuD-uL3T.png) |
| *Prompt*: `transform it into Jojo style` | *Characteristics*: Dynamic poses, bold manga shading |
<!--
## 🙂 Example
- transform it into Ghibli style
- Source Image
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/YSqHEgoMLoCWHB9r9rbL7.jpeg)
- Target Image
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/eryeU7hvA7gvkw1134gYU.jpeg)
- transform it into 3D Chibi style
- Source Image
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/1tuBpVvprYA3LaZl10gcN.jpeg)
- Target Image
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/KAPjcbO4FVvCnPf4Ny3UC.png)
- transform it into Oil Painting style
- Source Image
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/fdrT28mSr5OsxvV04pXZ8.jpeg)
- Target Image
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/8qCwpJpyDpScGpY8eMXno.png)
- transform it into Jojo style
- Source Image
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/hrw-jnm4cDoIOLr5DN0V-.jpeg)
- Target Image
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/O09TlMIMNDcU7HuD-uL3T.png)
-->
## ✨ Example Workflow
```mermaid
graph LR
A[Original Image] --> B(Kontext + LoRA)
B --> C{Style Prompt}
C -->|Ghibli| D["<img src='https://huggingface.co/datasets/svjack/Xiang_idol_Kontext_OmniConsistency_lora_Images/resolve/main/ghibli_example.jpg' width='150'/>"]
C -->|3D Chibi| E["<img src='https://huggingface.co/datasets/svjack/Xiang_idol_Kontext_OmniConsistency_lora_Images/resolve/main/chibi_example.jpg' width='150'/>"]
C -->|Oil Painting| F["<img src='https://huggingface.co/datasets/svjack/Xiang_OmniConsistency_Images/resolve/main/oil_example.jpg' width='150'/>"]
C -->|Jojo| G["<img src='https://huggingface.co/datasets/svjack/Premier_Zhou_OmniConsistency_Images/resolve/main/jojo_example.jpg' width='150'/>"]
C -->|Van Gogh| H["<img src='https://huggingface.co/datasets/svjack/Xiang_OmniConsistency_Images/resolve/main/vangogh_example.jpg' width='150'/>"]
```
**Explore more examples**:
- [Xiang Idol Style Transfers](https://huggingface.co/datasets/svjack/Xiang_idol_Kontext_OmniConsistency_lora_Images)
- [Xiang IceCream Style Transfers](https://huggingface.co/datasets/svjack/Xiang_IceCream_Kontext_OmniConsistency_lora_Images)
- [General Examples](https://huggingface.co/datasets/svjack/Xiang_OmniConsistency_Images)
- [Historical Transforms](https://huggingface.co/datasets/svjack/Premier_Zhou_OmniConsistency_Images)
---
## Model Details
- **Base Architecture**: Kontext (12B-parameter rectified flow transformer)
- **Fine-tuning**: LoRA adaptation for multi-style transfer
- **Model File**: [`my_first_flux_kontext_lora_v1_000005000.safetensors`](https://huggingface.co/svjack/Kontext_OmniConsistency_lora/resolve/main/my_first_flux_kontext_lora_v1_000005000.safetensors)