How do we parallelize in a node? We can use a foreach. Additionally, we can put each layer on a different core. There may be communication costs, but we could streamline. We could also try to modify the parameters as we go. The problems we discussed were slow communication, and each node may have a different performance.
How do we parallelize in a node? We can use a foreach. Additionally, we can put each layer on a different core. There may be communication costs, but we could streamline. We could also try to modify the parameters as we go. The problems we discussed were slow communication, and each node may have a different performance.