Instructions to use SUNQ111/SmartFreeEdit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SUNQ111/SmartFreeEdit with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SUNQ111/SmartFreeEdit", dtype=torch.bfloat16, device_map="cuda") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
metadata
license: other
language:
- en
pipeline_tag: image-to-image
library_name: diffusers
SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding
Qianqian Sun1*, Jixiang Luo2†, Dell Zhang2, Xuelong Li2
1 The University of Hongkong, 2 Institute of Artificial Intelligence (TeleAI)
Code
Please check our GitHub repository for code.