Sorry that sounds like such a waste of time. So sad that people are not even competent enough to do their jobs anymore. I think it is crazy enough that you even need a permit to build on your own land to begin with. What we consider freedoms now in the modern day are just illusion of freedom. Hope now that you have what you need and a more knowledgeable person to contact you can get back on track.