Inference adapts to your machine's resources and runs faster on more powerful machines, but it cannot run on every device.
To run Inference, we recommend at least:
- A 64-bit processor
- 4 GB of RAM
- 20 GB of free disk space
Additional requirements for Windows
To run on Windows you need Windows 10 or Windows 11 with Windows Subsystem for Linux (WSL 2) activated, unless you use the native Windows installer.
GPU recommended
Inference can use hardware acceleration on NVIDIA GPUs. It is not required, but for bigger models and live streaming video we recommend a CUDA-capable GPU.
Supported devices
You can run an Inference server on:
- ARM CPU (macOS, Raspberry Pi)
- x86 CPU (macOS, Linux, Windows)
- NVIDIA GPU
- NVIDIA Jetson (JetPack 4.5.x, 4.6.x, 5.x, 6.x)
You can also run Inference on a VM in your own cloud on AWS, Azure, or GCP, or let Roboflow host it for you: see Choosing a Deployment Option for the comparison. Other hardware may work but is not officially tested; see Using Other Devices.
Suggested edge devices
NVIDIA Jetson Orin devices with JetPack 5 or JetPack 6 are powerful, well-rounded machines, and the Roboflow test suite runs against them regularly. The Jetson Orin Nano Super Developer Kit is a good device to start building with.
Roboflow also sells a pre-configured Jetson-based edge device suitable for rapid prototyping.