People in a position to help you, like loan officers or employers, will judge you based on your credit score.
No, it's not fair. However, until a better alternative comes around you have to deal with the tools you have been given.
Avoid the embarrassment of a low credit score. Let us remove your errors so you can hold your head high.