He probably is going through or about to quill. The first major quilling is the hardest and a lot of love and patience is required. Don't stop your bonding patterns but switch them around so they involve less touching. A snuggle sack is perfect for this time. Also a couple of treats are in order to help both of you along. His adult personality is really starting to materialize here so how you react to his difficulties will have an impact.
You both will get through this and everything will be fine. Just understand that, like with people, hedgies can have bad days too. But they still need your love and companionship.