Parallelism overhead can also be the reason why small problem size is slow in this case.