Hmm. It shouldn't matter at all as to what kind, or how strenuous the activities are, it still goes through the same spend loop things, including the delay.
But let's see and confirm. Could you give me few examples of the higher effort activities where you don't notice the delay?
To experiment, you may also try to set the spend delay really high, say 250 or so, so that the effect is really noticeable.