I've had my modest Denon and KEF 5.1 system in the same room as my stereo because there was enough space. But I never really used the AV much and it was nowhere near the stereo in sq. having heard a couple of decent AV setups, including the magazine's own, I can imagine the top AV gear can sound good on music, but in my head I still think surround is for explosions and helicopters, but stereo is for music!
A blinkered view, I know.
So my answer s it really depends on your kit, but as you seem yo be much more music than cinema I wonder if you've tried cinema in 2.0 which I find quite satisfying.
Krell CD and amp, Michell/Rega/Grado record player, Hitachi and Sony tuners, Nakamichi cassette, SBT streamer, Sonus faber spkrs. Sony and Samsung BDP & TVs. Qobuz > iPad > AudioPro Allroom Air One