It may be unscientific, but it does happen, regularly, you just have to
like cricket to notice it.

I have been interested in this for many years, wondering if vapour
pressure was the culprit, but vapour pressure can be high on a summers
day with a high dewpoint but no low cloud and the ball doesn't swing at
all. However, on a cool morning with low stratus the ball will move in
the air until the stratus burns off and then not swing for the rest of
the day.
The Australia-Bangladesh odi at Sophia Gardens was a superb example of
this.

I have to admit that I am stumped, for an explanation.