-
“Algorithms for Modern Hardware” is an upcoming high-performance computing book by Sergey Slotin, aimed at a wide range of readers from performance engineers to undergraduate students. The book, hosted entirely on GitHub, focuses on using modern hardware’s parallelism capabilities for practical algorithm speed improvements. It is divided into various parts, with themes ranging from performance engineering to distributed computing, and encourages community contributions and feedback.
Main Points- Performance EngineeringThe book covers the basics of computer architecture and optimization of single-threaded algorithms, detailing CPU optimization topics like caching, SIMD, and pipelining.
- Parallel AlgorithmsAddresses concurrency, cache coherence, synchronization primitives, OpenMP, and more, focusing on models of parallelism and concurrent algorithms.
- Distributed ComputingExplores distributed computing topics like networking, message passing, distributed databases, and cloud computing.
- Software & HardwareCovers software and hardware aspects like LLVM IR, compiler optimizations, FPGAs, ASICs, TPUs, and other AI accelerators.
122004763