Guilty over using leather?

Ultimately it's up to you what you do, but if I loved riding horses, I would use the leather things, and I would just try to make them last a long time so I don't have to buy them more often than necessary. I wouldn't call you a hypocrite at all.