Maybe. Maybe not. I thought the same thing too about myself. But I proved the notion wrong and it's done wonders for my self-confidence. The difficult part is, only you can change both that perception and that reality.
I know I do the whole "I don't have faith in people" shtick but I'm pretty sure you're a safe bet to say it to, so I think you have the strength to change that. I know you've had it rough, more rough than most from what I have gleaned. But I think you're not as weak as you think.