They'll eventually despawn but it takes a few months. They won't turn into the quest; the quest is randomly generated and creates new robbers.
A while back someone posted a python script here for finding robbers for the quest -- it'll work for finding your regular robbers too if they haven't despawned.