How Radical is Judge Silberman?

CNN reports on the man who struck down the D.C. gun ban:

On Halloween night, crusty conservative Judge Laurence H. Silberman had a scary tale to tell fellow right-wingers gathered for dinner at Washington's University Club. He told in more detail than ever before how J. Edgar Hoover as FBI director "allowed -- even offered -- the Bureau to be used by presidents for nakedly political purposes." He called for the director's name to be removed from the FBI's J. Edgar Hoover Building in downtown Washington.

"In my view," Silberman said, "it is as if the Defense Department were named for Aaron Burr. Liberals and conservatives should unite to support legislation to accomplish this repudiation of a very sad chapter in American history."

Striking down gun bans and going after J.Edgar Hoover.Will the civil liberties community call Silberman a "right-wing extremist"?