If you feel guilty, you feel unhappy because you think that you have done something wrong or have failed to do something which you should have done.

Guilty is used of an action or fact that you feel guilty about.

If someone is guilty of a crime or offence, they have committed that crime or offence.

If someone is guilty of doing something wrong, they have done that thing.