Governor refuses to resign