Exploring Apple Silicon’s local AI performance with the Mac Studio and M4 Max — M4 Max beats GB10 and Strix Halo in decode throughput, but memory bandwidth isn't everything

Mac Studio M4 Max
(Image credit: Tom's Hardware)
6

Our local AI explorations in 2026 have so far focused on two main platforms: Nvidia’s GB10, as seen in the DGX Spark and Dell Pro Max with GB10, and AMD’s Ryzen AI Max+ 395, aka Strix Halo, as seen in the Corsair AI Workstation 300 and the Ryzen AI Halo. We’ve generally favored GB10 systems for these kinds of local AI development sandboxes. Their solid all-around performance and broad AI software compatibility make them easy to love, even if raw LLM inference throughput isn’t that high.

But Apple’s Mac Studio is another compelling option for local AI trailblazers who want systems with large unified memory pools, powerful GPUs, and high memory bandwidth to enable faster tokens-per-second throughput than either GB10 or Strix Halo can provide. And until someone builds another unified memory SoC with a memory bus as wide as what Apple uses for its Max and Ultra chips, Apple Silicon is, in fact, the only game in town for more memory bandwidth from a chip of this design.

Latest Videos FromTom's Hardware
Jeffrey Kampman
Senior Analyst, Graphics

As the Senior Analyst, Graphics at Tom's Hardware, Jeff Kampman covers everything that has to do with graphics cards, gaming performance, and more. From integrated graphics processors to discrete graphics cards to the hyperscale installations powering our AI future, if it's got a GPU in it, Jeff is on it. 

  • Kindaian
    There are some significant issues with using a mac though, specially in terms of service setup and containers (no gpu passthrough for containers under macos due to cpu/hardware limitations).

    If those are not important to you, then the comparison is fair i would guess. BUT also one consideration is the price in relation to the performance.
    Reply
  • splus
    I don't get it - why would you test the old M4 Max Studio when there's a new M5 Max MacBook, which is better and faster, especially for AI? And, as you said, the M4 Max Studio configuration you tested basically isn't even available any more?
    Reply
  • JamesJones44
    splus said:
    I don't get it - why would you test the old M4 Max Studio when there's a new M5 Max MacBook, which is better and faster, especially for AI? And, as you said, the M4 Max Studio configuration you tested basically isn't even available any more?
    Prior to Apple limiting the M4 Max Studios RAM I would have argued 256 GB of VRAM would be better for a pro user than the M5 Max 128 GB. However, with Apple cutting that option, I agree, the M5 Max 128 GB MBP would have been a better comparison
    Reply
  • splus
    JamesJones44 said:
    Prior to Apple limiting the M4 Max Studios RAM I would have argued 256 GB of VRAM would be better for a pro user than the M5 Max 128 GB. However, with Apple cutting that option, I agree, the M5 Max 128 GB MBP would have been a better comparison
    It's good to have more memory, but this hardware and its memory bandwidth is simply too low for larger models. It would be too slow to be useful. 256 or 512 GB would be useful only with much faster chip (like M5 Max or Mx Ultra) and with much higher memory bandwidth. M4 Max doesn't have either. Same applies to the Spark and Ryzen 395. 128 GB is their practical and usable max limit.
    Reply
  • Dmtrii
    I don't understand how you're testing Geekbench multi-core! Either Windows is broken (I don't know, I haven't used it for 10+ years) or you chose the wrong power profile.

    Here's my result of Geekbench 7 for the Strix Halo 128GB (Framework, Linux, Performance profile) - https://browser.geekbench.com/v7/cpu/1327
    More than 30 000 for multi-core!

    The same was for Geekbench 6 - every time I got 15% better results in multi-core 🤷‍♂️
    Reply
  • Bikki
    @Jefferey Lamma.cpp does not natively support mlx, it supports metal but not Mlx. Ollama or Llm studio do.

    On Ollama new mlx backend, Qwen prefill speed increases by 1.5x and decode 2-3x on m4 pro compared to old version that uses llama.cpp backend.

    Ps: I’m currently an AI engineer, gladly contributr to AI article’s process unpaid. contact me at bik.huynguyen gmail
    Ref: https://ollama.com/blog/mlx
    Reply