Previous | Next --- Slide 30 of 44
Back to Lecture Thumbnails
365sleeping

A tradeoff can be made in terms of update frequency. Reducing the frequency can reduce communication overheads.

captainFlint

I understand that it reduces communication overhead, however what's the flip side to reducing the frequency?

365sleeping

@captainFlint The flip side is to use the stale parameters, and thus the gradient may not be perfect.

Lotusword

Could worker nodes communicate data with each other?