Except where the reference is to a judicial hearing officer or a special referee, upon the entry of an order of reference, the clerk shall send a copy of the order to the referee. Unless the order of reference otherwise provides, the referee shall forthwith notify the parties of a time and place for the first hearing to be held within twenty days after the date of the order or shall forthwith notify the court that he declines to serve.
N.Y. CPLR R4313