In case anyone has this problem, here is what I did. I took it apart again and you have to be careful, these parts are fragile. The switch body has small tabs which snap into the outer mounting plate. I had 3 that were broken off.
I used gorilla glue on the switch to the plate. It is permanent but atleast it works.
