Section 23. Said board shall have the sole care, superintendence and management of all public burial grounds in its town, may lay out any existing public burial grounds in its town or any land purchased and set apart by said town for such cemeteries, in lots or other suitable subdivisions, with proper paths and avenues, may plant, embellish, ornament and fence the same and erect therein such suitable edifices and conveniences and make such improvements as it considers convenient; and, subject to the approval of the town, may make such regulations, consistent with law, as it deems expedient.