If you choose to become isolated and you already have a decent social structure around you you are relatively protected by malicious stories and other stuff and i am assuming that this is the case with you but if you go into isolation without having previously a social structure around you and having some real enemies then you are likely to have your reputation severely damaged by them by iteratively saying more extreme(perhaps imaginary) negative things about you.This may create a bunch of vicious cycles after you try to re enter social affairs that will lead to a reduction in your quality of life .