The special tax thus collected from the taxable property and polls of white persons shall be applied and expended exclusively for the purpose aforesaid of procuring buildings and grounds for, and in keeping up a graded public school, free for all white persons of both sexes within the school age resident in said town; and…