Chances are your replacement battery doesn't have foam tape taped around it. If you don't have a roll of foam tape lying around at home just gently peel off the tape from the old battery and aply it to the new battery. This will ensure that the battery will firmly be secured under the battery cover.