It seems that James Samuel Oscroft's first wife's (Mary Ellen Goodger, m. 1875) grandfather and two great grandparents were convicts. This *might* be the source of the family story about convicts in that line. Have still not been able to find a death for Mary Ellen Goodger (presume she died since he remarried my great grandmother in 1880) or found any children from that first marriage.
~Rebecca