Revelation (to reveal Christ) 12:17 And the dragon (devil) was wroth with the woman(church),and went to make war with the remnant (the part that is left) of her seed, which keep the (ten) commandments of God, and have the testimony of Jesus Christ.
It's not wrong to leave.
2Timothy 3:5 Having a form of godliness, but denying the power thereof: from such turn away.