Without them the device might not function properly in some cases. These are not heat shields, they are used for electromagnetic interference shielding. I was able to get them off by using a very small flat head screwdriver, just be careful not to tear the PCB. Hardest part was to remove the battery itself. Even with some nail polish remover, had to lightly bend the cells. :(