I've honestly never had an issue with him, but as I've said multiple times before I leveled up fast due to a lot of smithing-related stuff and the game has scaled the enemies to my level without my actual combat skills being caught up which is a big part of the issue and I'm just having to deal with it XD