In summary, the CPU is the host, which can decide how many blocks, how many threads per block, and how they synchronize with each other. The host will also take charge of copying data from the host to the device or from the device back to the host. On the contrary, the device is responsible for block assignment and computation.
In summary, the CPU is the host, which can decide how many blocks, how many threads per block, and how they synchronize with each other. The host will also take charge of copying data from the host to the device or from the device back to the host. On the contrary, the device is responsible for block assignment and computation.