Unable to change audio device when paused

I tried to change audio device when playback was on and saw that there was notification that in order to change the audio device, playback needs to be stopped. I paused the playback and notification was gone but I couldn’t change the device. I know that it says stopped, but if it’s possible could it be changed when paused too?

Paused is just sending silence to the audio device that is still used.
That’s why full stop (pressing on the stop (square) button is needed before changing audio device.