You can change the audio output on Android 11 by enabling Developer Mode. You can then switch devices from the notification ...
You can also disable the Android Auto Developer options from the same three-dot menu by selecting the Close developer mode ...