God has a way of silencing those against you as you live honorably.
Read: I Peter 2:12,15
12 Be careful to live properly among your unbelieving neighbors. Then even if they accuse you of doing wrong, they will see your honorable behavior, and they will give honor to God when he judges the world.
15 It is God’s will that your honorable lives should silence those ignorant people who make foolish accusations against you.