Instructions to use trollek/ImagePromptHelper-danube3-500M-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use trollek/ImagePromptHelper-danube3-500M-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("trollek/ImagePromptHelper-danube3-500M-GGUF", dtype="auto") - llama-cpp-python
How to use trollek/ImagePromptHelper-danube3-500M-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="trollek/ImagePromptHelper-danube3-500M-GGUF", filename="ImagePromptHelper-danube3-500m-f16.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use trollek/ImagePromptHelper-danube3-500M-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
Use Docker
docker model run hf.co/trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use trollek/ImagePromptHelper-danube3-500M-GGUF with Ollama:
ollama run hf.co/trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
- Unsloth Studio new
How to use trollek/ImagePromptHelper-danube3-500M-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for trollek/ImagePromptHelper-danube3-500M-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for trollek/ImagePromptHelper-danube3-500M-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for trollek/ImagePromptHelper-danube3-500M-GGUF to start chatting
- Docker Model Runner
How to use trollek/ImagePromptHelper-danube3-500M-GGUF with Docker Model Runner:
docker model run hf.co/trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
- Lemonade
How to use trollek/ImagePromptHelper-danube3-500M-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull trollek/ImagePromptHelper-danube3-500M-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.ImagePromptHelper-danube3-500M-GGUF-Q4_K_M
List all available models
lemonade list
Another image prompt helper
It can be used like my first image prompt helper, OR you can use one of the following prefixes to your prompt:
- Detailed:
- Very detailed:
- Danbooru:
- Mixed:
Thanks to MiaoshouAI for their Florence-2-large-PromptGen-v1.5 model, with which I created the SFT dataset this model was trained with.
Ollama
ollama pull trollek/imageprompthelper-danube3-500m
Examples
Prompt: a snake inside a boot in an art museum
Response: A vibrant and intricately decorated art exhibit features a large, slender python nestled inside a wooden box. The snake's body is adorned with colorful flowers and vines, and its eyes are closed as it gazes intently at the world below. The room is filled with antique art and antique furniture, creating a surreal and captivating scene.
Prompt: Danbooru: a snake inside a boot in an art museum
Response: solo, open mouth, no humans, 1girl, animal, plant, humanoid, animal focus, leather, green eyes, leather jacket, plant on ground, leather footwear, art museum
Prompt: Detailed: a snake inside a boot in an art museum
Response: a snake inside a black leather boots, placed inside the center of a dimly lit room, on the left side of the frame, the snake is positioned in front of a large window, allowing natural light to filter through and illuminate the scene, the background features a circular mirror, reflecting a snake-like creature that appears to be close to the camera, the leather boots are worn by an anthropomorphic creature with a slim body, wearing a black tunic underneath, the overall atmosphere is one of mystery and intrigue, inviting the viewer to step into the scene
Prompt: Mixed: a snake inside a boot in an art museum
Response: a photograph of a snake inside a wooden boot in an art museum, the snake is positioned in the center of the image, facing the viewer, its body is intricately detailed, with a smooth, textured surface that appears to be made of wood, and its head is adorned with small, delicate, curved scales that resemble scales, giving it a realistic, almost human-like appearance, the background features a grand, dimly lit room with large windows, allowing natural light to flood in, casting a soft glow on the room, the windows are framed with glass, allowing the viewer to see the snake inside the boot, the museum's walls are made of stone, with intricate carvings and ornate designs, adding to the historical context, the overall mood of one of awe and wonder, with the snake as the focal point, the photograph captures the essence of a museum's museum, emphasizing the intricate details and the natural beauty of the setting, the photograph captures the essence of a museum's historical and cultural heritage, making it a captivating and thought-provoking piece of art
(creature), no humans, animal, nature, scenery, wooden floor, museum, snake, wooden door, museum
- Downloads last month
- 197
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Model tree for trollek/ImagePromptHelper-danube3-500M-GGUF
Base model
h2oai/h2o-danube3-500m-base