I can't seem to remove planet component slots. For instance, after growing my empire quite a bit, I find that planet research labs to be not so useful as I now have plenty of room to build in orbit. Now I rather replace them with something else; maybe some garrison improvements.