Accusations that the secretary of state mishandled tens of thousands of voter registrations are sure to persist