Hi, I have a scarlett too. The way that worked for me is to go into settings and the audio settings, click on dac input - spl rate limit/no limit, then under low level playback untick “use large asio buffer”. Since then that seems to have solved it for me.
Was annoying also because sometimes I played along to songs with my guitar and the audirvana buffer kept changing it by default. Hope this works.