I doubt there's a limit. My issues with taking on robber bands has been to find enough people to recruit (although there was a bug causing former hirelings to never be available for hiring again, since fixed). I've tried to have bands of twice the number of robbers, plus the PC and the dog.
Also note that at some point the time it takes to get more hirelings will get long enough that the first ones hired are starting to leave.