Kakuu no Sono

After his mom's death, our protagonist strives for every bit of physical affection that his dad would show. Even as a toddler, his dad never held his hand or stroked his head.