Instructions to use SulphurAI/Sulphur-2-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use SulphurAI/Sulphur-2-base with Diffusers:

pip install -U diffusers transformers accelerate

import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("SulphurAI/Sulphur-2-base", dtype=torch.bfloat16, device_map="cuda")

prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]

llama-cpp-python

How to use SulphurAI/Sulphur-2-base with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="SulphurAI/Sulphur-2-base",
	filename="prompt_enhancer/mmproj-BF16.gguf",
)

llm.create_chat_completion(
	messages = "\"A young man walking on the street\""
)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use SulphurAI/Sulphur-2-base with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf SulphurAI/Sulphur-2-base:BF16
# Run inference directly in the terminal:
llama-cli -hf SulphurAI/Sulphur-2-base:BF16

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf SulphurAI/Sulphur-2-base:BF16
# Run inference directly in the terminal:
llama-cli -hf SulphurAI/Sulphur-2-base:BF16

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf SulphurAI/Sulphur-2-base:BF16
# Run inference directly in the terminal:
./llama-cli -hf SulphurAI/Sulphur-2-base:BF16

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf SulphurAI/Sulphur-2-base:BF16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf SulphurAI/Sulphur-2-base:BF16

Use Docker

docker model run hf.co/SulphurAI/Sulphur-2-base:BF16

LM Studio
Jan
Ollama
How to use SulphurAI/Sulphur-2-base with Ollama:
```
ollama run hf.co/SulphurAI/Sulphur-2-base:BF16
```

Unsloth Studio new

How to use SulphurAI/Sulphur-2-base with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for SulphurAI/Sulphur-2-base to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for SulphurAI/Sulphur-2-base to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for SulphurAI/Sulphur-2-base to start chatting

Pi new

How to use SulphurAI/Sulphur-2-base with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf SulphurAI/Sulphur-2-base:BF16

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "SulphurAI/Sulphur-2-base:BF16"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use SulphurAI/Sulphur-2-base with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf SulphurAI/Sulphur-2-base:BF16

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default SulphurAI/Sulphur-2-base:BF16

Run Hermes

hermes

Docker Model Runner
How to use SulphurAI/Sulphur-2-base with Docker Model Runner:
```
docker model run hf.co/SulphurAI/Sulphur-2-base:BF16
```

Lemonade

How to use SulphurAI/Sulphur-2-base with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull SulphurAI/Sulphur-2-base:BF16

Run and chat with the model

lemonade run user.Sulphur-2-base-BF16

List all available models

lemonade list

Hi.“I want to know where these two LoRA models are used and what the differences are between them。

by bsarea - opened 18 days ago

Discussion

bsarea

18 days ago

sulphur_lora_rank_768.safetensors & Itx-2.3-22b-distilled-lora-1.1_fro90_ceil72_condsafe.safetensors “I’m not sure whether these two LoRA models should be used together or separately. What are the differences between them, and where should each one be applied? Could you please advise?” Thanks

justinone123

18 days ago

•

edited 18 days ago

I need an answer too. Need settings to reduce movement artifacts/ghosting coming from these. Do i use Ceil72 alongside the 384 Lora?

denjay5

17 days ago

the sulphur_lora_rank_768 is amazing. I use it with a regular dev gguf ltx 2.3 along with the ltx 2.3 22b distilled lora 384 1.1. Then I added another lora node and load the the sulphur_lora_rank_768 . I added it like another regular lora. Works just fine for me. I set the lora model strength to about 0.8 to 1.0. By the way, I'm not an expert and I'm not sure if this is the correct way to use it. It just works in my case.

javawock7618

16 days ago

•

edited 16 days ago

Hi. In my case, the custom LTX-2.3 I2V/T2V workflow I built (and shared on Civitai) is working wonders with the combination of Distilled GGUF(unsloth LTX-2.3-GGUF) + VBVR LoRA + sulphur_lora_rank_768 LoRA. It delivers excellent results even for... well, 'certain' types of content, if you know what I mean. It’s performing absolutely brilliantly.

Notes and Additions)

Models that require ltx-2.3-22b-distilled-lora-1.1_fro90_ceil72_condsafe LoRA:

sulphur_dev_bf16.safetensors
sulphur_dev_fp8mixed.safetensors

Models that do NOT require ltx-2.3-22b-distilled-lora-1.1_fro90_ceil72_condsafe LoRA:

sulphur_distil_bf16.safetensors

When to use sulphur_lora_rank_768.safetensors:

This is required for standard LTX-2.3 models.

This is my current understanding.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment