Of course there is "Asperger's". It is a label for a particular range within the natural variations among brain architectures. There is in fact variations among neural architectures, with resulting differences in information processing. If one wants to argue that we should not pathologize neurological differences, then I am very much on board.
Psychiatry is the medical branch of psychology, much like medical doctors are the medical branch of human biology. So it's wrong to even call it a science. I would say that they are in the same position now as doctors were in the 19th century -- causing probably as much harm as good. But if we had stopped medical doctors from practicing, they would have never gotten to where they are now. Of course, there is still a ways for even them to go.
Psychiatry certainly has a lot of growing up to do. It needs to depathologize mere differences. But that means psychiatrists need to stop thinking of themselves as doctors.