It definitely makes a difference when doing distributed rendering but the proportion of bucket size to speed depends on the model, memory, processor speed, and image size. It's not proportional, so a 32x32 bucket is slower than a 64x64 bucket but a 128x128 may not be faster than the 64x64.