Data processing unit

A data processing unit (DPU) is a programmable <a href="/facts/Processor_(computing)/z3wPljrI">computer processor</a> that tightly integrates a general-purpose <a href="/facts/CPU/Jxp1bqMV">CPU</a> with <a href="/facts/Network_interface_controller/wyf5FR29">network interface</a> hardware. Sometimes they are called "IPUs" (for "infrastructure processing unit") or "SmartNICs". They can be used in place of traditional <a href="/facts/Network_interface_controller/wyf5FR29">NICs</a> to relieve the main CPU of complex networking responsibilities and other "infrastructural" duties; although their features vary, they may be used to perform <a href="/facts/Encryption/16q29Fdv">encryption/decryption</a>, serve as a <a href="/facts/Firewall_(computing)/Et2RkJaU">firewall</a>, handle <a href="/facts/TCP/IP/KNkxtSpw">TCP/IP</a>, process <a href="/facts/HTTP/TWtvf7JD">HTTP</a> requests, or even function as a <a href="/facts/Hypervisor/3gX9fKlH">hypervisor</a> or <a href="/facts/Disk_array_controller/XcbylFek">storage controller</a>. These devices can be attractive to <a href="/facts/Cloud_computing/guhg0FGV">cloud computing</a> providers whose servers might otherwise spend a significant amount of CPU time on these tasks, cutting into the cycles they can provide to guests.
<a href="/facts/AI_Factory/XxlxFdes">AI factories</a> are an emerging use case for DPUs. In these environments, massive amounts of data must be moved rapidly among <a href="/facts/CPUs/Jxp1bqMV">CPUs</a>, <a href="/facts/GPUs/PTK1RQVp">GPUs</a>, and storage systems to handle complex <a href="/facts/Artificial_intelligence/lJGauQwX">AI</a> workloads. By offloading tasks such as packet processing, encryption, and traffic management, DPUs help reduce latency and improve energy efficiency, enabling these AI factories to maintain the high throughput and scalability needed for advanced machine learning operations.
Alongside their role in accelerating network and storage functions, DPUs are increasingly viewed as the “third pillar of computing,” complementing both CPUs and GPUs. Unlike traditional processors, a DPU typically resides on a network interface card, allowing data to be processed at the network’s line rate before it reaches the CPU. This approach offloads critical but lower-level system duties—such as security, load balancing, and data routing—from the central processor, thus freeing CPUs and GPUs to focus on application logic and AI-specific computations.

Data processing unit open-in-new

Data processing unit