Some of the census records will tell you where Oliver's parents were born. Do you know where they were born? If not, look at those records. You need to know if your looking for them in New York or elsewhere, although, of course, you know that Oliver was born in New York, it will still help you narrow your search for his parents.