Data parallelism is an approach towards parallel processing that depends on being able to break up data between multiple compute units (which could be cores in a processor, processors in a computer, ...
Introduction to parallel computing for scientists and engineers. Shared memory parallel architectures and programming, distributed memory, message-passing data-parallel architectures, and programming.