@scottwilson Can the router be put into a lock box or locked room so he can't have access? Your ability to work should not depend on his whim.
It's also possible that guilt from his early years caused you to allow treatment as if you're his peer instead of his authority.
What did you do...