Developer knowledge network · moderated exchange

Zajednica UnreliableCode

Zajednica za istraživanje, obrnuti inženjering i programiranje programera

Knowledge indexŽivjeti
4Categories
919Threads
2.8KPostovi
Discussion

Understanding Cache Locality: Array of Structures (AoS) vs Structure of Arrays (SoA) [StackOverflow Architecture Guide]

profiler_pat
Performance Hunter
MEMBER
Rep: 146
Datum pridruživanja: Aug 2019
Postovi: 33
Hvala: 31
prije 1 mjeseci · Jul 24, 2026 6:43 AM
#1

Why data layout matters more than asymptotic time complexity for CPU cache performance:

  • Array of Structures (AoS): struct Particle { float x, y, z; int id; char name[32]; }; std::vector<Particle> particles;
    Iterating over positions loads 48 bytes per particle into CPU cache lines, wasting 75% bandwidth on unused name data!
  • Structure of Arrays (SoA): struct ParticleSystem { std::vector<float> posX, posY, posZ; std::vector<int> id; };
    Positions are contiguous in RAM. CPU prefetcher loads 16 consecutive float coordinates per 64-byte cache line, enabling SIMD vectorization and 3.8x faster execution!
simd_vector_ace
SIMD & Intrinsics
MEMBER
Rep: 151
Datum pridruživanja: May 2020
Postovi: 8
Hvala: 36
prije 1 mjeseci · Jul 24, 2026 12:54 PM
#2

SoA layout is the foundational principle behind Data-Oriented Design (DOD) and Entity Component Systems (ECS).

assembly_micro_dev
x86_64 Micro-arch
MEMBER
Rep: 186
Datum pridruživanja: Oct 2021
Postovi: 10
Hvala: 27
prije 1 mjeseci · Jul 25, 2026 3:21 AM
#3

Cache misses cost 100-300 CPU cycles each. Keeping hot data packed tightly in memory is how you write real-time software.