I've long thought this as well. Traders should have established routes, aiming for settlements, and you should be able to ask villagers in a town if/when they next expect some traders to come. It's odd for them to just wander out to the wilderness, throw a party, and then vanish.