Just curious, is atomic operation implemented by locking the memory bus and thus no other outstanding requests can be issued before the operation actually completes ?

Please see @bpr's answer on this slide.