I'd say it depends on where your going, how long for and if you can take a cage and all the heat and stuff with you.
If going abroad then its a huge no.
But if going a couple hours away, and your not going to long, and you have no one else who can go and look after the hedgehog, as long as you can provide heat for the journey there and back, a large cage or make shift cage, and heat for the cage as well all bits you normally need then I cant see it being a huge problem, just have familiar things and things smelling of you in the cage. It should be fine. And dont break its usual routine.
Although some people will say its a no either way.