My experience is that
peppers are very robust plants-- they can tough it through a lot of insults. Can you let us know a little bit more about the circumstances of your plant? Where are you located? Is the plant in the ground or in a pot? How much rain have you gotten? And so on. A photo would be helpful.
Bottom line-- I'd pick the
pepper you have if it's anywhere near ripe. But tell us more about it.