Anyway to play a game in a window but still be able to hear it

[pcslookout]

I am looking to play my games in a window but still be able to hear it when I browse the web while waiting for the new match to begin. Happens around ever 50 minutes sometimes. I want to be able to still hear the game so I know when the new match is starting. I tried the game in windowed mode but when I minimize it or go to a different window like firefox the sound for the game cuts out.