Yes, I'd defiinitely use some speakers. Transducers of some sort are probably essential for listening to music.
Bedroom: Esoteric RZ-1, PMC DB1i, Fostex CW200A. FUBAR IV
Office: Nuforce Icon HDP, Adam A7X
Living room: Apple TV, FIIO D03K, Fostex PM0.4n
Headphones: Audio Technica ATH-AD900x and ATH-A900x, Sennheiser HD595, Grado SR80i
I agree, definently something to induce a little noise is preferable with most hifi. although i have heard some where the sound of silence would have been better.