Listen but don't comment - if you do, you can be sure it will get back to your boss and it is your review that will negatively affected.

I have often worked with and for people who were not always well liked by co-workers, clients, etc.  I just listened and took it all with a grain of salt.  None were doing anything unethical or that would negatively impact me - just rubbed folks the wrong way like your boss.  In some cases, I used those situations to my advantage.  We did work on state contracts that involved EEO documentation/processes.  My boss and the guy in charge of EEO on that districts projects, to put it mildly, had an extreme dislike for each other.  I made a point of be very friendly and helpful to the EEO rep and interceded between my boss and him.  Since I became the point of contact, neither had to deal with each other directly and both were happier for it.  Requirements of the EEO rep were met and my boss stayed out of trouble because things were done as requested and on time.

Maybe you can do something similar - when your boss has to deal with someone he dislikes or you know dislikes him, offer to be a go between of sorts.  This will make you more valued and maybe even help you acquire some duties more to your liking.

Michelle