Posted in

AMD just dropped a compact AI workstation that makes discrete GPUs look outdated for…

The topic AMD just dropped a compact AI workstation that makes discrete GPUs look outdated for… is currently the subject of lively discussion — readers and analysts are keeping a close eye on developments.

This is taking place in a dynamic environment: companies’ decisions and competitors’ reactions can quickly change the picture.

AMD has announced the availability of the Ryzen AI Halo developer platform, powered by AI Max 300-series processors. This range of mini PCs isn’t going to win awards for gaming prowess, nor are they designed as low-cost options for attaching behind workstation monitors.

For the time being, AMD will offer just one SKU for sale, rocking the Ryzen AI Max+ 395, but more models will roll out later in the year with Ryzen AI Max PRO 400-series chips, some of which will likely be more affordable. These capable compact boxes will allow developers (and prosumers) to run local LLMs with up to 192 GB of unified memory.

Powering the single SKU launching in June is the mighty AMD Ryzen AI Max+ 395 with its impressive 16 physical cores and 32 threads. Capable of boosting up to 5.1 GHz, this is an absolute beast of a mobile processor and has been featured in other products. AMD chose the chip to launch the Ryzen AI Halo developer platform thanks to the inclusion of 80 MB of cache, AMD Radeon 8060S graphics, and a 650 TOPS NPU. Combine all of that with 128 GB of unified memory, and you’ve got the ultimate application for running local LLMs without delay. We love this processor.

With one of these mini PCs, it’ll be possible to run larger local AI models with all that dedicated RAM. That beastly CPU, NPU, and GPU combo ensures that AI development workflows are streamlined, with support for AMD ROCm and widely used frameworks and tools. Though AMD has lagged behind Nvidia’s AI push and platform support, the company is certainly looking to cause a splash with this thing. 128GB of RAM is perfect for reducing reliance on cloud resources for testing, fine-tuning, and development, something that even the incredibly popular RTX 3090 would struggle with.

The first Ryzen AI Halo won’t be cheap, however, with an MSRP of $3,999. You can thank the pricing of parts for that, as well as the niche nature of the device itself. Pre-orders commence in June 2026, but it’ll be the next wave of SKUs that will really make this an interesting proposition by AMD. This 300-series AI Halo hasn’t even launched yet, and the company has already outed what’s next with Ryzen AI Max PRO 400 series CPUs. These Zen 5 chips combine RDNA 3.5 graphics with XDNA 2 NPUs to deliver some impressive results, being among the first x86 client chips to run 300B models. So, yes, we’re talking super-large LLMs.

The Max+ 395 is impressive on its own, but the Max+ PRO 495 and the rest of the 400-series take things up a notch further with up to 192 GB of RAM. Compare that to the 16 GB or so you’re using with a discrete GPU for running LLMs at home, and it’s clear to see what league these are in a league of their own. But it’s not just for running and developing LLMs. These chips are great for design, rendering, simulation, and engineering, making the Ryzen AI Halo quite the option for enthusiasts and developers. The best part is how AMD focused on making it easier to get up and running.

Picking one with the above chips will land you a system capable of handling the largest modern models. AMD provides a ready-to-use software stack for Windows and Linux, consisting of the Ryzen AI Developer Center, apps and model preloads, and playbooks to offer guided workflows. ROCm is fully supported out of the box with optimized performance and SOTA model support, fully utilizing the wider platform of validated tools, frameworks, and drivers. It’s quite the compelling platform, bolstered with up to 2 TB of PCIe Gen 4.0 storage, 10Gbps networking, and Wi-Fi 7.

Nvidia already has the DGX Spark out and running, but it’s limited to Linux, lacks an NPU, and offers weaker performance, according to the data AMD’s data. We look forward to getting our hands on one to test, as even the Apple Mac Mini M4 Pro and its fantastic optimized hardware and software stack for running AI, struggles to run models larger than 100B, which is something the Ryzen AI Halo can do and then some. And with a TDP of 150W, you’re looking at a monthly bill of around $16 with a per kWh price of $0.15 — Not bad when compared to the price of AI cloud platforms.