Fixing loose remote port

We have a 60D and the port for the wired remote has become dislodged and is now loose just under the left side cover rendering the remote unusable. I removed the small philips screw in the center of the cover to see if it can be popped off but I don’t want to accidentally break it. Can this cover be removed in order to fix the loose port? Thanks in advance!