Is it one sided?

You guys are still pretty young. Just take it slow. Hold hands, etc. He's probably just as nervous as you and will take sometime to come out of his shell a bit.