Hot code refers to a critical block of code which is used repeatedly and is compute bound. This is where we can increase performance by improving parallelization.