Walker Hanson had married, but hid his mistress off to the side. Then when the mistress got pregnant, to show no shame, he had his wife Diana pretend that she was pregnant. During this time, his mistres hid out in the house until the birthing.
The doctor, who was doing the delivery, felt such sadness and pity for the young mistress. So when she birthed twin sons, he only gave Walker and Diana the first. Keeping the second hidden for the mistress to care for.
With being banished from the house now, and not wanting the shame of an unwed mother, the mistress fled to another state to raise her son Jonny.
Leaving the boys to never know of their twin brother.
Okay, solved that mystery!