Section 24. The guardian of a married person unless authorized by the court for causes which the court considers sufficient, shall not have the care, custody or education of his ward, except in case of the mental illness of the spouse of such person, or of his abandoning such person and making no sufficient provision therefor.