I have been studying Albert Dutton who married Delia Ann
Wilkins in Shelby county, Illinois. As a consequence, I have been looking at all the Dutton families in Shelby, Effingham and Fayette counties Illinois. It appears that they all may be related to each other. It is interesting that the name Dutton is spelled Dutting on the 1850 census in Effingham County. It is spelled Ditton on the 1850 census in Shelby county.
Anyway, I assume this is the 1850 census for your Lemuel(index appears to list him as Samuel) Dutton:

Image 12
1850 census Shelby county Town dist
Samuel Dutting 52 m Delaware
Nancy 49 f Maryland
John 22 m IL
Martin 18 m IL
Abriham 16 m IL
Mary 13 f IL
Sariah 12 f IL
Milia 10 f IL

1860 census Illinois Shelby county
Nancy Dutton 52 PA
Abraham 26 OH
Sarah E. 18 IL
Mildred 16 IL

1860 census Illinois Shelby county
Martin B. 27 OH
Nancy 28 IL
Emma 3 IL

The Albert Dutton I am looking for may be Alfred
listed below. The ages match.
Abraham Dutton listed below appears to have moved
to Effinham County and married Harriet E.(Annie)Scaefe.
This Abraham Dutton appears to have died in East St. Lewis Illinois.
Abraham and Harriets' son Dudley Sylas Dutton died in St. Lewis County, Missouri.

Harriet may be living with Albert's son Oscar on the 1930 census in Effingham County , Illinois.

1850 census Illinois Shelby county Town Dist.
Harris Dutting 49 m Delaware
Milton 28 m N Y
William 17 m OH
Jane 15 f OH
Alfred 13 m OH
Levi 10 m OH
Edward 8 m OH
Sarah 6 f OH
Abriham 4 m Oh
Martha 41 f OH
Mary 1 f OH
Becker 60 m Delaware
Ariena 38 f NY

1860 census Illinois Effingham County
Albert Dutton 22m OH engineer
Della 19 f Oh
Cora 1 f IL

1870 census Illinois Fayette County Avena twp
Albert Dutton 33 m OH
Ann 31 f IL
Henry 4 m IL
Oscar 2 m IL

1880 census Illinois Effingham County Villiage of Alamont
Delia Dutton 40 IL KY KY
Henry 14 IL OH IL
Oscar 12 IL OH IL
Franklin 9 IL OH IL
George 7 IL OH IL

1880 census Illinois Effingham
Abram Duttan 33
Harriet 21
John 4

1900 censu Illinois Effingham
Abram Dutton 57 IL DEL DEL
Annie 40 IL IL IL
Jonhie 22 IL IL IL
Thomas 19 IL IL IL
Millie 17 IL IL IL
Dudley 14 IL IL IL
Effie 7 IL IL IL
Arthor 5 IL IL IL

1910 census Illinois Effingham County Mound Alamont City
Dutton, Abraham H. 68 IL DEL DEL
, Harriet E. 49 IL IL IL
, John C. 34 IL IL IL
, Nellie Mae 25 IL IL IL
, Dudley S. 22 IL IL IL
, Effie B. 17 IL IL IL
, Arthur H. 14 IL IL IL

1920 census Missouri, St. Lewis County St. Lewis City
Dutton, A. H. 51 widow IL PA PA ????
, D S 30 son IL Ver Ver
, Author 24 son IL Ver Ver.

Image 40
1850 census Illinois Effingham County
Margaret Ditton 54 f PA
Thomas 23 m OH
Sarah 21 f OH
Catherine 19 f OH

1860 census Effingham County Town Dist P.O.Ewington
Thos Dutton 31 m OH
Hariet 24 f IL
Sarah 5 f IL
Ann 4 f IL
Mary 2 f IL
Margaret 72 f OH

I would like to learn more about how all of these familes
are related.