Some huddled in shelters but others started fleeing the town