Hi,
In my opinion, this is a question of ethics and policy for within your own company. Yes, the IT guy at your company should only be accessing your computers when you have an issue (and have specifically asked the IT guy for support) or if he has to access your computer to "push" some sort of update. He should not just "sneak" into your computer without your knowledge that he is doing so.
Again, this is just MY opinion, and your company may have a different opinion.
When he is using TeamViewer, I THINK that your computer will always let you know (via a pop-up) that your IT guy is getting into your computer. I do not think it is possible for the IT guy to use TV to "sneak" into your computer without your knowledge while you are sitting at the computer, but I may be mistaken. However, there are certainly other methods your IT guy could use to "sneak" into your computer without your knowledge. And of course, he could get into your computer when you are not sitting in front of it, but your computer is no (for example, after work or during a lunch break). My point is, this is not a TeamViewer issue, it is a trust/ethics/policy issue for your company.
- - fred