Instructions to use holipori/saved_model_git-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use holipori/saved_model_git-base with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="holipori/saved_model_git-base")

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("holipori/saved_model_git-base")
model = AutoModelForMultimodalLM.from_pretrained("holipori/saved_model_git-base")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use holipori/saved_model_git-base with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "holipori/saved_model_git-base"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "holipori/saved_model_git-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/holipori/saved_model_git-base

SGLang

How to use holipori/saved_model_git-base with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "holipori/saved_model_git-base" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "holipori/saved_model_git-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "holipori/saved_model_git-base" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "holipori/saved_model_git-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use holipori/saved_model_git-base with Docker Model Runner:
```
docker model run hf.co/holipori/saved_model_git-base
```

saved_model_git-base

Commit History

update model card README.md

fc04dc6

Xinyue Hu commited on May 23, 2023

Model save

a951273

Xinyue Hu commited on May 23, 2023

Training in progress, step 17000

65bb1d2

Xinyue Hu commited on May 23, 2023

Training in progress, step 16000

b3f720d

Xinyue Hu commited on May 23, 2023

Training in progress, step 15000

f64bf09

Xinyue Hu commited on May 23, 2023

Training in progress, step 14000

64484d8

Xinyue Hu commited on May 23, 2023

Training in progress, step 13000

a404cf2

Xinyue Hu commited on May 23, 2023

Training in progress, step 12000

8e954c3

Xinyue Hu commited on May 23, 2023

Training in progress, step 11000

23ac020

Xinyue Hu commited on May 23, 2023

Training in progress, step 10000

96973f4

Xinyue Hu commited on May 23, 2023

Training in progress, step 9000

83ad1b1

Xinyue Hu commited on May 23, 2023

Training in progress, step 8000

045f527

Xinyue Hu commited on May 23, 2023

Training in progress, step 7000

626ac50

Xinyue Hu commited on May 23, 2023

Training in progress, step 6000

80f593a

Xinyue Hu commited on May 23, 2023

Training in progress, step 5000

c22c316

Xinyue Hu commited on May 23, 2023

Training in progress, step 4000

8d412e5

Xinyue Hu commited on May 23, 2023

Training in progress, step 3000

895cf08

Xinyue Hu commited on May 23, 2023

Training in progress, step 2000

9dd83e4

Xinyue Hu commited on May 23, 2023

Training in progress, step 1000

6c17360

Xinyue Hu commited on May 23, 2023

update model card README.md

a5744d3

Xinyue Hu commited on May 23, 2023

Model save

d4132b5

Xinyue Hu commited on May 23, 2023

Training in progress, step 23000

004b6c8

Xinyue Hu commited on May 23, 2023

Training in progress, step 22000

62ed1cc

Xinyue Hu commited on May 23, 2023

Training in progress, step 21000

ad1224f

Xinyue Hu commited on May 23, 2023

Training in progress, step 20000

079dfbe

Xinyue Hu commited on May 23, 2023

Training in progress, step 19000

3457d58

Xinyue Hu commited on May 23, 2023

Training in progress, step 18000

d2a8422

Xinyue Hu commited on May 23, 2023

Training in progress, step 17000

b437c44

Xinyue Hu commited on May 23, 2023

Training in progress, step 16000

32661f4

Xinyue Hu commited on May 23, 2023

Training in progress, step 15000

e07d303

Xinyue Hu commited on May 23, 2023

Training in progress, step 14000

9607bed

Xinyue Hu commited on May 23, 2023

Training in progress, step 13000

39527bf

Xinyue Hu commited on May 23, 2023

Training in progress, step 12000

972db94

Xinyue Hu commited on May 23, 2023

Training in progress, step 11000

ed4da43

Xinyue Hu commited on May 23, 2023

Training in progress, step 10000

2f64048

Xinyue Hu commited on May 23, 2023

Training in progress, step 9000

d61b430

Xinyue Hu commited on May 23, 2023

Training in progress, step 8000

f6fec0e

Xinyue Hu commited on May 23, 2023

Training in progress, step 7000

dee93c1

Xinyue Hu commited on May 23, 2023

Training in progress, step 6000

7f1a91d

Xinyue Hu commited on May 23, 2023

Training in progress, step 5000

88b0381

Xinyue Hu commited on May 22, 2023

Training in progress, step 4000

6646066

Xinyue Hu commited on May 22, 2023

Training in progress, step 3000

907476a

Xinyue Hu commited on May 22, 2023

Training in progress, step 2000

2d052dc

Xinyue Hu commited on May 22, 2023

Training in progress, step 1000

0bfe895

Xinyue Hu commited on May 22, 2023

initial commit

f1979f2

Xinyue Hu commited on May 22, 2023

Commit History

update model card README.md fc04dc6

Model save a951273

Training in progress, step 17000 65bb1d2

Training in progress, step 16000 b3f720d

Training in progress, step 15000 f64bf09

Training in progress, step 14000 64484d8

Training in progress, step 13000 a404cf2

Training in progress, step 12000 8e954c3

Training in progress, step 11000 23ac020

Training in progress, step 10000 96973f4

Training in progress, step 9000 83ad1b1

Training in progress, step 8000 045f527

Training in progress, step 7000 626ac50

Training in progress, step 6000 80f593a

Training in progress, step 5000 c22c316

Training in progress, step 4000 8d412e5

Training in progress, step 3000 895cf08

Training in progress, step 2000 9dd83e4

Training in progress, step 1000 6c17360

update model card README.md a5744d3

Model save d4132b5

Training in progress, step 23000 004b6c8

Training in progress, step 22000 62ed1cc

Training in progress, step 21000 ad1224f

Training in progress, step 20000 079dfbe

Training in progress, step 19000 3457d58

Training in progress, step 18000 d2a8422

Training in progress, step 17000 b437c44

Training in progress, step 16000 32661f4

Training in progress, step 15000 e07d303

Training in progress, step 14000 9607bed

Training in progress, step 13000 39527bf

Training in progress, step 12000 972db94

Training in progress, step 11000 ed4da43

Training in progress, step 10000 2f64048

Training in progress, step 9000 d61b430

Training in progress, step 8000 f6fec0e

Training in progress, step 7000 dee93c1

Training in progress, step 6000 7f1a91d

Training in progress, step 5000 88b0381

Training in progress, step 4000 6646066

Training in progress, step 3000 907476a

Training in progress, step 2000 2d052dc

Training in progress, step 1000 0bfe895

initial commit f1979f2

update model card README.md

fc04dc6

Model save

a951273

Training in progress, step 17000

65bb1d2

Training in progress, step 16000

b3f720d

Training in progress, step 15000

f64bf09

Training in progress, step 14000

64484d8

Training in progress, step 13000

a404cf2

Training in progress, step 12000

8e954c3

Training in progress, step 11000

23ac020

Training in progress, step 10000

96973f4

Training in progress, step 9000

83ad1b1

Training in progress, step 8000

045f527

Training in progress, step 7000

626ac50

Training in progress, step 6000

80f593a

Training in progress, step 5000

c22c316

Training in progress, step 4000

8d412e5

Training in progress, step 3000

895cf08

Training in progress, step 2000

9dd83e4

Training in progress, step 1000

6c17360

update model card README.md

a5744d3

Model save

d4132b5

Training in progress, step 23000

004b6c8

Training in progress, step 22000

62ed1cc

Training in progress, step 21000

ad1224f

Training in progress, step 20000

079dfbe

Training in progress, step 19000

3457d58

Training in progress, step 18000

d2a8422

Training in progress, step 17000

b437c44

Training in progress, step 16000

32661f4

Training in progress, step 15000

e07d303

Training in progress, step 14000

9607bed

Training in progress, step 13000

39527bf

Training in progress, step 12000

972db94

Training in progress, step 11000

ed4da43

Training in progress, step 10000

2f64048

Training in progress, step 9000

d61b430

Training in progress, step 8000

f6fec0e

Training in progress, step 7000

dee93c1

Training in progress, step 6000

7f1a91d

Training in progress, step 5000

88b0381

Training in progress, step 4000

6646066

Training in progress, step 3000

907476a

Training in progress, step 2000

2d052dc

Training in progress, step 1000

0bfe895

initial commit

f1979f2