Locate the clip holding the battery cover on the mouse and use a sputter or your nail to push it aside to allow the door to spring up.

This can take a few attempts especially if your mouse is well used and trying different approaches may get it to open up. For mine I had to slightly push the door down to open it.

Once the door pops up remove it but keep it close.