That the State, county and city convicts may be used in the construction of the said railroad and its branches, on such terms, in such manner and at such times as may be agreed upon by the proper authorities in charge of said convicts and by said railroad company.