Sound keeps cutting out with my headphones

Periodically the sound cuts out for about 2-3 seconds then comes back, during that time the video (be it game or Netflix) is completely unaffected.

Also this never happens when the sound is coming out my speakers.  On a side note when the sound cut out the mic on the headset still works perfectly fine and anyone can hear me.