Home / Company / Blog / Rethinking the MCU Architecture for Edge AI

Rethinking the MCU Architecture for Edge AI

Inside the Architecture of the Synaptics Astra® SR200 Series of xMCUs  

Edge AI changes the microcontroller design challenge. Adding a faster CPU or attaching an AI accelerator isn’t enough when a device must continuously interpret vision, voice, audio and sensor data within a tightly constrained power envelope. The processors have to be fed with enough data to stay productive, the right compute resources have to wake at the right moment, and the entire system has to move between microwatt monitoring and high-performance inference with application-processor-class performance and I/O capabilities.  

This is the design challenge that Synaptics aims to solve with the Astra SR200 Series of xMCUs. The Astra SR200 Series combines the ideas and concepts behind the vision-first SR100 and the audio-first SR80 into an organic, grounds-up scalable AI-native architecture with high-capacity extensible memory. The SR200 Series is a portfolio of multiple product lines developed for multiple markets and applications. 

Meeting these requirements involves several connected design decisions. Different workloads need different processing resources, and those resources need enough memory capacity and bandwidth to remain productive. Continuous monitoring requires careful control over which parts of the device stay active, while multimodal applications need coordinated processing of different sensor inputs.  

Heterogeneous Compute Matches Cores to Workloads 

Continuous monitoring and demanding bursts of processing place different requirements on a device. Using the same processing resource for both makes it harder to balance responsiveness and energy consumption. The SR200, therefore, combines processing resources suited to different workloads. 

At the top tier of general-purpose processing, Synaptics integrated the Arm® Cortex®-M85 core. The Cortex-M85 turns on instantaneously to execute heavy algorithmic tasks at high speed, allowing the system to quickly finish processing and return to a low-power sleep state.  

Complementing the Cortex-M85 is the Arm Cortex-M52 core, which serves as a highly efficient background observer. The Cortex-M52 delivers an optimal balance between low-power operation and modern execution performance, enabling continuous system monitoring at a minimal energy footprint. 

Beyond the general-purpose CPU cores, the SR200 incorporates the Synaptics Torq neural processing unit for dedicated neural-network processing. Developed as a continuation of Synaptics' joint engineering efforts with Google on the Coral architecture, the Torq NPU delivers 400 GOPS of dedicated neural processing. While raw spec numbers like GOPS provide a basic benchmark, the true value of the Torq NPU lies in its real-world functional capabilities. The integrated accelerator empowers the SR200 to execute localized speech recognition with real-time text conversion, multi-object scene classification, spatial segmentation, and image identification directly on the device. By combining the Cortex-M85, Cortex-M52, DSPs, and the Torq NPU into a single unified fabric, Synaptics enables microcontrollers to reach into entry-level Linux processor territory without incurring typical MPU power penalties. 

Designing Memory for Edge AI Workloads  

AI performance at the edge depends on whether the memory subsystem can hold the required model data and deliver it quickly enough to the processing cores. For memory-bound workloads, adding more compute does not remove that constraint. The SR200’s memory design therefore addresses both capacity and bandwidth. 

To solve this memory constraint for tiny edge devices, Synaptics rethought how data flows to the compute engine in the architecture of the xMCU. On the internal silicon layer, Synaptics designed a wider, high-bandwidth memory fabric with built-in hardware security. This internal interconnect allows all CPU cores, DSPs, and the neural processor to access internal memory banks simultaneously without creating bus contention. 

For external memory expansion, Synaptics introduced an in-package custom DRAM interface that functions similarly to High Bandwidth Memory found in high-end data center silicon. Synaptics is bringing this HBM-like concept down into the microcontroller market in a version that scales to hundreds of megabytes of RAM. This custom DRAM pipeline enables the SR200 Series to feed massive neural network parameters to the compute cores at unprecedented speeds, allowing the chip to run complex multimodal AI models locally. Crucially, this wide memory pipeline achieves its speed while reducing memory power consumption by 300% compared to the alternative DRAM solutions on the market. 

Tiered Power Domains that benefit from Process Node Efficiency 

A device that monitors its surroundings continuously does not need every processing core, peripheral and memory block active all the time. The power-management challenge is to keep the resources needed for monitoring available while activating additional resources as the workload requires. That requirement led to the SR200’s four-domain power-management approach. 

The power management framework is structured across four distinct power domains:  

  1. Always-On domain
  2. Ultra-Low power domain
  3. Low power domain
  4. High-performance domain 

This quad-domain structure grants system designers granular control over hardware resources. Peripherals, memory blocks, and processing cores can be powered on or shut down instantaneously based on immediate workload requirements. For example, a wireless camera monitoring a remote pipeline valve or substation can idle in an ultra-low-power state for weeks on battery, then wake its vision processing the instant a sensor detects movement or a change in gauge position.

Synaptics achieved these power efficiencies through strategic process node selection and continuous manufacturing refinement in partnership with TSMC. Rather than adopting risky, expensive one-off sub-threshold process techniques, Synaptics built the SR200 on a proven process node. By combining TSMC's 12e node with ultra-low-leakage SRAM cells and custom layout designs, Synaptics achieved industry-leading energy metrics while maintaining a clear, reliable evolutionary roadmap toward future nodes like 6e.   

Multimodal Sensing and Physical AI Integration 

Physical AI applications rarely rely on a single sensor input. Devices installed in home, commercial, and industrial environments must parse vision, voice, audio, and time-series sensor data simultaneously. Synaptics engineered the SR200 sensor pipeline to ingest and process these diverse data streams concurrently without performance degradation. 

In vision processing, the SR200 incorporates a specialized dual-path Image Signal Processor supporting simultaneous Machine Vision and Human Vision pipelines. This dual-path ISP allows the system to perform contextual AI analysis and high-quality image capture at the same time. For instance, the machine vision path can scan a broad field of view, use localized AI models to identify a specific region of interest, and trigger the human vision path to capture a high-resolution zoomed photograph of the targeted subject in real time. 

In addition to consumer smart home capabilities, Synaptics tailored the SR200 Series for physical AI, robotics, and edge automation. The silicon integrates high-speed industrial communication interfaces directly into the platform, including gigabit Ethernet and CAN FD controllers. These integrated networking pipelines allow the SR200 to act as an intelligent edge node that processes complex sensor inputs locally and distributes action commands across industrial networks in real time. 

Open Software Stack Drives Innovation Through Community Collaboration 

AI models, quantization methods and optimization techniques continue to evolve. Developers need tools they can inspect and adapt as their application requirements change. Another recurring challenge in the microcontroller market is vendor lock-in caused by proprietary software toolchains and closed-source compilers. Synaptics addresses this barrier by providing an open software stack and Edge AI compiler ecosystem for the SR200 family. 

This open software strategy aligns with Synaptics' core philosophy regarding the rapid pace of AI innovation. Because models, quantization methods, and optimization techniques evolve continuously, closed and proprietary software environments are challenged to keep pace. This dynamic is comparable to the cloud computing landscape, where open-source Linux software powers most global enterprise servers and AI workloads. 

By opening its software compiler repositories and tools to the developer community, Synaptics empowers customers to inspect code, customize compilers for proprietary AI models, and collaborate directly on software enhancements. This open ecosystem eliminates vendor lock-in while accelerating the deployment of next-generation physical AI applications. 

Defining the Future of Microcontrollers 

The Synaptics Astra SR200 Series of xMCUs redefines the boundaries of Edge compute by marrying high-performance heterogeneous cores with an extensible HBM-class memory architecture, quad-domain power management, multimodal sensing, and open-source software flexibility. By overcoming the traditional bottlenecks of legacy microcontrollers, Synaptics provides developers and enterprise customers with a purpose-built platform designed to power the next generation of intelligent Edge and Physical AI devices. 

John Weil

John Weil is Vice President of IoT and Edge AI Processor Business at Synaptics Incorporated. Before his role at Synaptics, John was the Chief Marketing Officer at Foundries.io, where he played a pivotal role in new business development focusing on Software as a Service (SaaS). He also held high-level positions at Cypress Semiconductor Corporation, where he was Vice President and General Manager of the IoT Subsystems Business Unit. Earlier in his career, John worked at Freescale Semiconductor in various capacities, including Operations and Marketing Manager for Industrial MCU Solutions and Global Product and Enablement Manager for Industrial MCU Business. John earned a Bachelor of Science in Electrical Engineering from the Rose-Hulman Institute of Technology.

Read more by John Weil
AI Edge Computing
Receive the latest news