Any possible chance James Layton went by Leighton/Layton?
With the age difference of 32 years between he and Vivian, which not unheard of, but a bit rare, may not be the James Morgan you have in your tree. The source citation on your James Morgan is James H. Morgan exact same birth and death date, buried with wife Minty in Jackson,KY.
I found in a 1920 census, one that might be more of your grandfather- if you can check with your father for names of aunts, uncles, grandparents if they sound remotely familiar.

1920 Census KY Worren, Knox,
(Indexed this way- as enumerators spelled names phonetically)

Morgan, Gaither-35 name is actually Griffin in other census records
Morgan, Martha- wife 32 (Martha Ellen Moore)
children listed
Richard 10
Obert 8
Laton 5 1/2
Miette 2(Myrtle A.)



They are found again in 1930 Laurel County Census, Laurel County, KY
Morgan, Griffin 46
Martha, 42
John O. 18
Leighton 15
Myrtle A. 12
Nancy T. 9
David 7

This Layton/Leighton would put him born ca 1914, just a few years older than Vivian and still in same area.

I'm still searching 1940 census for he and Vivian since they should be married, with the birth of the child that died in 1939.

If so, this would be his death record
James L Morgan
Death Date: 24 May 1994
Death Place: Knox
Age: 78
Residence: Laurel
Volume: 29
Certificate: 14213

A very small clipping from Lexington Herald Leader on death, but the Corbin paper if anyone has access to looking them up, should have more information on survivors to confirm, or even the funeral home.
Friday, May 27, 1994
CORBIN -- Layton Morgan, 78, brother of Thelma Eckner, died Tuesday. Services 2 p.m. today, O'Neil Funeral Home. Visitation 9 a.m. today.

* Thelma is listed in 1940 Census with father Griffin