It was first owned by the father of John M. Williamson, who once served as Brookhaven Town supervisor, records show.