Personally I don't mind that some items can't be repaired, certainly it would be nice to be able to repair wool clothing (especially the rare ones like socks) but I think it's also somewhat nice that you have to keep looking for these things and get some spares. And ofcourse metal armor might be a bit beyond the possibilities of a lone wanderer to repair, especially since the tribes don't seem to actually make it themselves as far as I'm aware.
And either way, a small scratch from falling off a tree won't affect the clothings stats, atleast not noticeably. I also find that if you have good armor that blocks the damage you take, the armor actually doesn't really get damaged at all, so once you get metal armor it's actually pretty tough to lose durability on it, much less any wool or linen clothing underneath. And really, full fur clothing is the best clothing
, with some extra additions like wool/linen mittens/socks/cowls and leather boots, and a leather belt for style.