The youngest child was only one year old and took the baby in his arms with love