Perplexity Ships Hybrid Compute to Keep Sensitive Data Local
TL;DR
- PII-Tracer, Perplexity's 0.6B routing classifier, improves long-context sensitive-data recall from 0.687 to 0.965 on conversations exceeding 10,000 characters.
- On-device task steps consume no cloud credits, so the privacy benefit also creates a direct cost advantage for high-volume sensitive workloads.
- Perplexity open-sourced PII-Tracer and its evaluation benchmark, letting enterprise IT audit and tune the cloud/local split threshold for compliance purposes.
Perplexity's newest Mac feature routes some of your prompts to models running on your own laptop instead of its cloud. The company calls it Hybrid Compute, and Engadget reports that a built-in privacy classifier scans anything you upload or send and flags what should stay local.
"Any time you try to upload files or send information, we're going to automatically check for sensitive content," Jon Staff, who oversees Perplexity's Mac products, told Engadget. Users review those recommendations before the system splits work between models.
Local runs use Gemma E4B or one of two 35-billion-parameter Qwen variants, one of them post-trained by Perplexity. The app installs the models itself, no terminal required, and shows live CPU, GPU, memory, and token counters while a query runs. Cloud work still goes to frontier models including Opus 5 and GPT-5.6 Sol. Local tokens are not billed.
Staff was blunt about the trade-off. "The short answer is that a fully frontier output is going to almost always be better in terms of raw artifact creation. It's more expensive, it's more capable," he said, framing the choice as "a sliding scale" the user controls.
Hybrid Compute requires Apple Silicon Macs on macOS 15 with at least 32GB of unified memory, and it ships to Pro, Max, and enterprise subscribers, with iPhone task queuing included. That hardware floor sits on the same platform Apple has been leaning on for on-device AI, and it lands in a run of Apple-side stories our tracker has logged, including this week's Mac mini and Studio supply squeeze.
Engadget's write-up leans on the lawyer example: compare privileged case details against public case law without shipping the file to a server. Whether the classifier is accurate enough to trust with that call is a question the piece does not answer.
What others are reporting
-
9to5Mac Read →
Frames the launch within Perplexity's Mac strategy and Apple's co-promotion alongside the M6 Mac mini; specifies 24GB RAM minimum, 32GB recommended for optimal performance.
Computer starts each task in the cloud. Trigger one from your iPhone, and your Mac accesses your files and runs sensitive steps locally.
-
Unite.AI Read →
Names PII-Tracer as the 0.6B routing classifier and surfaces the economic angle: on-device steps carry no cloud credit cost alongside the privacy benefit.
Work handled by the local model uses no cloud credits.
-
MarkTechPost Read →
Deepest technical coverage: details PII-Tracer's 37-label token classification, constrained Viterbi decoding, sliding-window inference, and 79.4% vs 57.0% recall over GPT-5.6 on recurring identifiers.
Computer hands sensitive steps down to the local model on the Mac without restarting the task or losing context then merges both halves into one result.
Originally reported by engadget.com
Read the original article →Original headline: Perplexity Ships Hybrid Compute for Mac, Auto-Routes Sensitive Prompts to Local Qwen 3.6 and Gemma E4B