I created a guest group which has an access right which I used for displaying thing to guests only, so that menus, modules, etc... do not show to members.
Anyway, what happened is, I changed one of the tab's permission to guest, now, it shouldn't show to members and it should only show to guests because that's how the ACL is setup. However, what happened is that the tab become hidden from me in the backend, along with all the fields within it. So, I couldn't change it's permission anymore because it is hidden.
Of course, I went to the DB table and changed the permission of the table back. However, I doubt that this should be happening!
I've solved this as you can but I wanted to report it in case it was a bug.