It is known that the ancient Egyptians were hit heavily by both small pox and venereal disease to the point that it may have caused their civilization to nearly disappear. The Roman Empire was also hit with these two diseases later. Anyone fled the plagues who was able so disease may be one substantiation of your theory