Text Generation
Transformers
Safetensors
French
fiscalité
génération-de-texte
français
8-bit precision
Instructions to use Aktraiser/modele-test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Aktraiser/modele-test with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Aktraiser/modele-test")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Aktraiser/modele-test", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use Aktraiser/modele-test with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Aktraiser/modele-test" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Aktraiser/modele-test", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Aktraiser/modele-test
- SGLang
How to use Aktraiser/modele-test with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Aktraiser/modele-test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Aktraiser/modele-test", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Aktraiser/modele-test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Aktraiser/modele-test", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Aktraiser/modele-test with Docker Model Runner:
docker model run hf.co/Aktraiser/modele-test
Commit History
Update README.md 5b589d1 verified
Update README.md 1f02434 verified
Update README.md 881a4ff verified
Update README.md 34cdc7e verified
Update README.md 034aec4 verified
Update README.md 26c9d93 verified
Update README.md 716a74d verified
Update README.md 116d00a verified
Update handler.py 37b22c3 verified
Update requirements.txt 9823ac3 verified
Update handler.py c61068e verified
Update handler.py 2a70625 verified
Create handler.py 421ac56 verified
Create requirements.txt 5d0a536 verified
Update README.md 5bb9256 verified
Add model description eae79b7
« Aktraiser » commited on
Add model files with LFS tracking aab89c0
« Aktraiser » commited on
Add LFS tracking configuration 55ba190
« Aktraiser » commited on