What he said. The only times I really have any issues with daytime hunting is in the summer, around 8PM where everything has heated up to about animal temperature, but once the sun goes down a bit more, things cool off rapidly and you are GTG.
Most of my hunts start in the evening, long before the sun goes down.