What compute does Annie require to run?
Annie's compute requirements depend on the number of pipeline roles active simultaneously, the scale of the enterprise deployment, and the frequency of Cognition Stream fine-tuning runs.
Indicative minimum requirements for a production deployment:
- GPU — NVIDIA A100 or equivalent; minimum 8× GPU for a full pipeline configuration (more for larger organisations or high-throughput use cases)
- RAM — 512 GB minimum for model weights and inference context
- Storage — 10 TB minimum for model weights, task data, and Cognition Stream artefacts
- Network — high-bandwidth internal networking between GPU nodes; external connectivity is optional
These figures are indicative. The enterprise briefing process produces a detailed infrastructure specification based on your organisation's use case, task volume, and pipeline configuration.
Infrastructure partners hosting Annie deployments for multiple enterprise customers should expect GPU utilisation profiles characteristic of sustained inference workloads — distinct from the bursty patterns typical of public cloud consumption.