Section 41. Choice of the directors mentioned in section forty shall be made in such towns by the board of selectmen, and in such cities by the mayor, not later than fifteen days following the vote authorizing the appropriation specified in section forty. The directors shall serve for such terms as the mayor in cities and the town meeting in towns shall determine.