Skip to content
MappleCare Community ↗

MappleCare Community

Reply To: [Solved] Mac Studio M2 Max encountering Local LLM / MLX Framework Unified Memory Allocation Out-of-Memory Panic after update (macOS Sonoma 14.7)

Find answers from other Apple users or start a discussion about your device.

All Forum Rooms

Home › Forums › Apple Silicon, Terminal & Developer Tools › [Solved] Mac Studio M2 Max encountering Local LLM / MLX Framework Unified Memory Allocation Out-of-Memory Panic after update (macOS Sonoma 14.7) › Reply To: [Solved] Mac Studio M2 Max encountering Local LLM / MLX Framework Unified Memory Allocation Out-of-Memory Panic after update (macOS Sonoma 14.7)

#11971
Robert Lange
Community Contributor
Apple Recommended / Verified Community Solution
This canonical solution was verified and marked as solved in the Apple Support Community archive.

Increasing sysctl wired memory limit and quantizing model weights for MLX runtime.

Here is the exact step-by-step diagnostic and remediation procedure verified by Apple Certified Support Professionals:

  1. Increase sysctl wired unified memory limit:
    sudo sysctl iogpu.wired_mem_limit=180000
  2. Load models using 4-bit or 8-bit quantization (e.g. mlx-lm.generate --model mlx-community/Llama-3-70B-4bit).
  3. Flush system unified cache before heavy inference passes:
    sudo purge

Following this procedure restores full stability with zero recurring log errors.

MacBook Pro 14″ M3 Pro (36GB) | OWC Envoy Pro FX | iPad Pro 13″ M4 | Seattle, WA
Apple Certified Support Professional (ACSP) | Commercial Photographer & Digitech