I would say it depends how far you have to move it – as Williamc says – they are very particular about house location.
An alternative would be to move him very gently, in his house during the day when asleep – we do this when soft releasing hogs after introducing them to the outside world again.
Dusk is a better time to do it – because if they are disturbed and do emerge shortly afterwards to check out whats happening, then they aren’t subjected to daylight roaming.
good luck – hope whatever you try it works and he decides to stay put.