It means that you are held out and punished and ridiculed for your beliefs and actions. This can be anything from being jailed to being harassed because of who you are and nothing more. Someone whom is persecuted is usually excluded and openly subjected to bad treatment and conditions.
