In my opinion, data parallel is a method that calculate a group of data at the same time, and there are no communication between these operations. So I am pretty confused: why the data parallel model is one model of communication?
Lotusword
@xiaoguaz From my perspective, the agents will exchange information globally after they perform an action on separate elements of a data set simultaneously. The global reorganization of data may be accomplished through accesses to shared addresses or messages, since the data parallel processing model only defines the overall effect of the parallel steps. The definition of this model can be found in book Parallel Computer Architecture--A Hardware/Software Approach P42.
In my opinion, data parallel is a method that calculate a group of data at the same time, and there are no communication between these operations. So I am pretty confused: why the data parallel model is one model of communication?
@xiaoguaz From my perspective, the agents will exchange information globally after they perform an action on separate elements of a data set simultaneously. The global reorganization of data may be accomplished through accesses to shared addresses or messages, since the data parallel processing model only defines the overall effect of the parallel steps. The definition of this model can be found in book Parallel Computer Architecture--A Hardware/Software Approach P42.