*facepalm*
Go use a hex editor and open ZOOMMAPS.DAT, each data chunk is 88392 bytes. Just keep those you want + visited settlements and delete others.
You also need to delete related data in ZOOMINDEX.DAT. Deleting visited settlements will create new villagers on next visit but may have unknown consequences.