Infer Ring

By Mikita Rodzin on AppTrack Ninja.

Distributed LLM inference

Infer Ring enables local LLM inference by combining the memory of multiple iOS and macOS devices. Just run the app on each device to pool their RAM and unlock models that wouldn’t fit on a single machine. Infer Ring works over both Wi-Fi and wired connections — simply connecting devices with a USB cable lets you immediately utilise their combined power. Supports both tensor and pipeline parallelism.

Categories: Developer Tools, Entertainment

App Store rankings, screenshots, estimates and similar apps for Infer Ring.