I am not saying your DH is like this, but my DH often says DH cried all day when in reality he didn't. He is not lying he just really sees it that way sometimes. (Other days his mindset is right and DH is a little more mellow and they have the most fun in the world) Sometimes when my DS is in an especially high needs stage and it is DH's day to have him I will often get texts and calls saying all he has done is scream, or I will come home to hear that he has cried all day and didn't nap. If I call back in the day DS is always quiet and cooing/babbling or napping. My DH just has a tendency to always see the worst and forget about the good. My DH is a worrier and I think the tendencies go hand in hand. Is it possible that this is the case with your DH?
(I should state that DS is generally a happy baby if you are willing to interact with him 24/7 but is capable of not napping and never really has taken naps that are much longer than 1/2 hr)