Update README.md (#5)
Browse files- Update README.md (9a7fe41c9ce02636682451064dce028d64f0c279)
Co-authored-by: Kun Yan <[email protected]>
README.md
CHANGED
|
@@ -21,13 +21,13 @@ pipeline_tag: image-to-image
|
|
| 21 |
|
| 22 |
|
| 23 |
# Introduction
|
| 24 |
-
We are excited to introduce Qwen-Image-Edit, the image editing version of Qwen-Image. Built upon
|
| 25 |
|
| 26 |
Key Features:
|
| 27 |
|
| 28 |
-
* **
|
| 29 |
-
* **Precise Text Editing**: Qwen-Image-Edit supports bilingual (Chinese and English) text editing, allowing direct
|
| 30 |
-
* **Strong
|
| 31 |
|
| 32 |
|
| 33 |
|
|
@@ -72,45 +72,45 @@ with torch.inference_mode():
|
|
| 72 |
```
|
| 73 |
|
| 74 |
## Showcase
|
| 75 |
-
One of Qwen-Image-Edit
|
| 76 |
|
| 77 |
-
|
|
|
|
| 78 |
|
| 79 |
-
|
| 80 |
|
| 81 |
|
| 82 |
-
Another
|
| 83 |
|
| 84 |
-
In addition to semantic editing, appearance editing
|
| 85 |
-
|
| 86 |
|
| 87 |
-
|
| 88 |
|
| 89 |
-
|
| 90 |
|
| 91 |
-
Appearance editing
|
| 92 |
|
| 93 |
|
| 94 |
-
|
| 95 |
-
For example, the following two images demonstrate Qwen-Image-Edit’s ability in editing English text:
|
| 96 |
|
| 97 |
|
| 98 |
-
Qwen-Image-Edit can also edit Chinese posters
|
| 99 |
|
| 100 |
-
Finally, let
|
| 101 |
|
| 102 |
-
|
| 103 |
|
| 104 |
-
|
| 105 |
|
| 106 |
-
|
| 107 |
|
| 108 |
|
| 109 |
|
| 110 |
|
| 111 |
|
| 112 |
-
|
| 113 |
-
In summary, we hope Qwen-Image-Edit
|
| 114 |
|
| 115 |
|
| 116 |
## License Agreement
|
|
|
|
| 21 |
|
| 22 |
|
| 23 |
# Introduction
|
| 24 |
+
We are excited to introduce Qwen-Image-Edit, the image editing version of Qwen-Image. Built upon our 20B Qwen-Image model, Qwen-Image-Edit successfully extends Qwen-Image’s unique text rendering capabilities to image editing tasks, enabling precise text editing. Furthermore, Qwen-Image-Edit simultaneously feeds the input image into Qwen2.5-VL (for visual semantic control) and the VAE Encoder (for visual appearance control), achieving capabilities in both semantic and appearance editing. To experience the latest model, visit [Qwen Chat](https://qwen.ai) and select the "Image Editing" feature.
|
| 25 |
|
| 26 |
Key Features:
|
| 27 |
|
| 28 |
+
* **Semantic and Appearance Editing**: Qwen-Image-Edit supports both low-level visual appearance editing (such as adding, removing, or modifying elements, requiring all other regions of the image to remain completely unchanged) and high-level visual semantic editing (such as IP creation, object rotation, and style transfer, allowing overall pixel changes while maintaining semantic consistency).
|
| 29 |
+
* **Precise Text Editing**: Qwen-Image-Edit supports bilingual (Chinese and English) text editing, allowing direct addition, deletion, and modification of text in images while preserving the original font, size, and style.
|
| 30 |
+
* **Strong Benchmark Performance**: Evaluations on multiple public benchmarks demonstrate that Qwen-Image-Edit achieves state-of-the-art (SOTA) performance in image editing tasks, establishing it as a powerful foundation model for image editing.
|
| 31 |
|
| 32 |
|
| 33 |
|
|
|
|
| 72 |
```
|
| 73 |
|
| 74 |
## Showcase
|
| 75 |
+
One of the highlights of Qwen-Image-Edit lies in its powerful capabilities for semantic and appearance editing. Semantic editing refers to modifying image content while preserving the original visual semantics. To intuitively demonstrate this capability, let's take Qwen's mascot—Capybara—as an example:
|
| 76 |
|
| 77 |
+
As can be seen, although most pixels in the edited image differ from those in the input image (the leftmost image), the character consistency of Capybara is perfectly preserved. Qwen-Image-Edit's powerful semantic editing capability enables effortless and diverse creation of original IP content.
|
| 78 |
+
Furthermore, on Qwen Chat, we designed a series of editing prompts centered around the 16 MBTI personality types. Leveraging these prompts, we successfully created a set of MBTI-themed emoji packs based on our mascot Capybara, effortlessly expanding the IP's reach and expression.
|
| 79 |
|
| 80 |
+
Moreover, novel view synthesis is another key application scenario in semantic editing. As shown in the two example images below, Qwen-Image-Edit can not only rotate objects by 90 degrees, but also perform a full 180-degree rotation, allowing us to directly see the back side of the object:
|
| 81 |
|
| 82 |
|
| 83 |
+
Another typical application of semantic editing is style transfer. For instance, given an input portrait, Qwen-Image-Edit can easily transform it into various artistic styles such as Studio Ghibli. This capability holds significant value in applications like virtual avatar creation:
|
| 84 |
|
| 85 |
+
In addition to semantic editing, appearance editing is another common image editing requirement. Appearance editing emphasizes keeping certain regions of the image completely unchanged while adding, removing, or modifying specific elements. The image below illustrates a case where a signboard is added to the scene.
|
| 86 |
+
As shown, Qwen-Image-Edit not only successfully inserts the signboard but also generates a corresponding reflection, demonstrating exceptional attention to detail.
|
| 87 |
|
| 88 |
+
Below is another interesting example, demonstrating how to remove fine hair strands and other small objects from an image.
|
| 89 |
|
| 90 |
+
Additionally, the color of a specific letter "n" in the image can be modified to blue, enabling precise editing of particular elements.
|
| 91 |
|
| 92 |
+
Appearance editing also has wide-ranging applications in scenarios such as adjusting a person's background or changing clothing. The three images below demonstrate these practical use cases respectively.
|
| 93 |
|
| 94 |
|
| 95 |
+
Another standout feature of Qwen-Image-Edit is its accurate text editing capability, which stems from Qwen-Image's deep expertise in text rendering. As shown below, the following two cases vividly demonstrate Qwen-Image-Edit's powerful performance in editing English text:
|
|
|
|
| 96 |
|
| 97 |
|
| 98 |
+
Qwen-Image-Edit can also directly edit Chinese posters, enabling not only modifications to large headline text but also precise adjustments to even small and intricate text elements.
|
| 99 |
|
| 100 |
+
Finally, let's walk through a concrete image editing example to demonstrate how to use a chained editing approach to progressively correct errors in a calligraphy artwork generated by Qwen-Image:
|
| 101 |
|
| 102 |
+
In this artwork, several Chinese characters contain generation errors. We can leverage Qwen-Image-Edit to correct them step by step. For instance, we can draw bounding boxes on the original image to mark the regions that need correction, instructing Qwen-Image-Edit to fix these specific areas. Here, we want the character "稽" to be correctly written within the red box, and the character "亭" to be accurately rendered in the blue region.
|
| 103 |
|
| 104 |
+
However, in practice, the character "稽" is relatively obscure, and the model fails to correct it correctly in one step. The lower-right component of "稽" should be "旨" rather than "日". At this point, we can further highlight the "日" portion with a red box, instructing Qwen-Image-Edit to fine-tune this detail and replace it with "旨".
|
| 105 |
|
| 106 |
+
Isn't it amazing? With this chained, step-by-step editing approach, we can continuously correct character errors until the desired final result is achieved.
|
| 107 |
|
| 108 |
|
| 109 |
|
| 110 |
|
| 111 |
|
| 112 |
+
Finally, we have successfully obtained a completely correct calligraphy version of *Lantingji Xu (Orchid Pavilion Preface)*!
|
| 113 |
+
In summary, we hope that Qwen-Image-Edit can further advance the field of image generation, truly lower the technical barriers to visual content creation, and inspire even more innovative applications.
|
| 114 |
|
| 115 |
|
| 116 |
## License Agreement
|