AMD EPYC 9354 Processor – Gadget Salvation Blog

AMD EPYC 9354 Processor – Gadget Salvation Blog

Summary

The AMD EPYC 9354 processor is an integral part of AMD’s 4th Generation EPYC 9004 series, which carries the codename “Genoa”. It marks a significant evolution in server processor technology, introducing the Zen 4 architecture and a new platform built around the SP5 socket. This architectural shift is not merely an incremental upgrade. Its fundamental re-engineering is designed to address the escalating demands of contemporary and future data center environments. The Zen 4 architecture, coupled with the new SP5 platform, brings crucial advancements such as support for DDR5 memory and PCIe Gen 5.0 connectivity.

The EPYC 9354 CPU is strategically positioned as a “high-end” performance chip, catering to organizations with demanding computational needs. AMD claims superior energy efficiency for business applications, so let’s see if that holds.  

AMD EPYC 9354: Technical Specifications and Architecture

image 8

The AMD EPYC 9354 is a robust server processor featuring 32 physical cores and 64 threads, achieved through AMD’s Simultaneous Multithreading (SMT) technology. This high core and thread count is fundamental to its ability to handle parallelized workloads efficiently. The processor operates with a base frequency of 3.25GHz, which can dynamically boost to an all-core frequency of 3.75GHz and a maximum turbo frequency of 3.8GHz under optimal conditions.  

The EPYC 9354 incorporates a sophisticated cache hierarchy to minimize data access latency. It features a substantial 256MB of Level 3 (L3) cache, which serves as a large, shared pool of fast memory for all cores. In addition to the L3 cache, each of the 32 cores has its own dedicated Level 1 (L1) and Level 2 (L2) caches. Specifically, there are 32KB of L1 Instruction Cache and 32KB of L1 Data Cache per core, complemented by 1MB (1024KB) of L2 Cache per core. This multi-level caching system ensures that frequently accessed data is readily available to the processing cores, significantly improving overall responsiveness and throughput. The processor’s Thermal Design Power (TDP) is rated at 280W, with a configurable TDP (cTDP) range that allows adjustments between 240W and 300W to balance performance and power consumption based on specific deployment needs.

Memory Subsystem

Utilizing DDR5 technology, the EPYC 9354 supports up to 4800 MHz of maximum memory frequency for rapid data transfer rates. A critical aspect of its memory subsystem is its support for 12 memory channels, which provides an exceptional per-socket memory bandwidth of 460.8GB/s. The processor can support a substantial maximum memory capacity of up to 6TB per socket, enabling it to handle very large in-memory datasets and demanding applications.

I/O Capabilities

Connectivity and data transfer are paramount in modern server environments, and the AMD EPYC 9354 excels in this regard. It offers up to 128 PCIe Gen 5.0 lanes. This is a significant upgrade, as PCIe 5.0 provides double the throughput of PCIe 4.0, which is crucial for high-speed networking, NVMe storage, and connecting performance-intensive accelerators like GPUs. Beyond traditional PCIe, the processor also supports Compute Express Link (CXL) 1.1+. CXL enables memory expansion and disaggregated compute architectures, allowing for flexible resource pooling and addressing larger in-memory workload capacity needs, which is particularly beneficial for emerging data center paradigms.

AMD EPYC 9354 Performance

The AMD EPYC 9354 demonstrates strong performance across various benchmarks, reflecting its architectural optimizations for server workloads. In the widely recognized PassMark CPU Mark test, a single AMD EPYC 9354 processor achieves an average score of 72,615. When configured in a dual-CPU system, the performance scales significantly, reaching an average CPU Mark of 113,042, showcasing its robust scalability for demanding, multi-socket environments. For applications sensitive to individual core performance, the EPYC 9354 registers a competitive Single Thread Rating of 2,601 MOps/Sec.

image 9

The performance figures reveal a balanced profile for the AMD EPYC 9354. As we can see, it is not exclusively designed for highly parallel tasks but also maintains responsiveness and efficiency for applications that are sensitive to single-core performance.

This balanced performance profile makes the EPYC 9354 a versatile choice for data centers and enterprises. It can efficiently execute highly parallelized applications, such as high-performance computing or big data analytics, while simultaneously ensuring smooth operation for applications that rely on strong single-core performance, including certain database operations or legacy software. This versatility can lead to more effective resource utilization and a simplified approach to infrastructure management, as a single processor type can address a broader range of computational needs.

Advanced Security Features: AMD Infinity Guard

The AMD EPYC 9354, as a member of the 4th Generation EPYC 9004 series, integrates AMD Infinity Guard, a sophisticated suite of security features embedded directly into the silicon. This comprehensive approach to security is designed to protect sensitive data from the foundational silicon level all the way up to the application layer, providing a multilayered defense against modern threats.  

Key components of AMD Infinity Guard

image 10
  • AMD Secure Boot: Provides a robust defense against firmware-level threats. It extends the silicon root of trust to cryptographically validate the initial BIOS software boot, ensuring that the system starts without corruption from malicious code.  
  • Transparent Secure Memory Encryption (TSME): Designed to safeguard against internal security threats, including sophisticated cold-boot attacks. It achieves this by encrypting all data residing in the main memory.
  • AMD Shadow Stack: Provides hardware-enforced stack protection, a crucial defense against malware attacks such as return-oriented programming (ROP).
  • Secure Encrypted Virtualization (SEV): Encrypts and protects each Virtual Machine’s (VM) memory space from the hypervisor and other VMs by using individual, unique encryption keys. For 4th Gen EPYC processors, SEV supports up to 1006 keys and offers the flexibility of limitless encrypted memory capacity, including support for CXL memory expansion.  
  • SEV Encrypted State (SEV-ES): Provides an additional layer of protection by securing the contents of VM registers when the Virtual Machine is offline or in a suspended state.  
  • SEV Secure Nested Paging (SEV-SNP): Enhances VM integrity and confidentiality, offering protection against malicious hypervisors. It strengthens cloud security across diverse workloads and provides optional defenses against threats.
  • Trusted I/O: This feature extends the guest’s Trusted Execution Environment (TEE) to encompass external trusted devices, such as GPUs and accelerators. This ensures data protection when processed by or transferred to these high-performance peripherals.

Conclusion

The AMD EPYC 9354 emerges as a highly capable and strategically important server processor within the 4th Generation Genoa family. Its competitive performance against Intel counterparts, particularly in multi-threaded tasks and overall value, solidifies its position as a compelling option for enterprises and cloud providers seeking high-performance and efficient infrastructure.

Finally, as always, don’t forget that you can trade in your older computer for cash with Gadget Salvation!


10fb1d12ef7c7a0ad7706426c7391f18a6952743ff973e58e15afdc55491efc3?s=150&d=mp&r=g

Olena is an operations manager at Gadget Salvation, wearing many hats and navigating the intersections of efficiency and innovation. With a deep passion for tech and sustainability, they thrive on exploring solutions that drive progress while protecting our planet.

Leave a Comment

Comments

No comments yet. Why don’t you start the discussion?

    Leave a Reply

    Your email address will not be published. Required fields are marked *