File size: 397 Bytes
5acccb6
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
# Python inference

The two Python runtimes are isolated because they target different hardware and dependencies.

| Directory | Backend | Model files |
| --- | --- | --- |
| `ax650/` | PyAXEngine on AX650 / NPU3 | Packaged `*.axmodel` files |
| `pytorch/` | PyTorch on CPU, CUDA, or MPS | Original upstream FP checkpoints |

See the repository root `README.md` for installation and run commands.