“They were having a tougher time than we thought,” retired Justice Stephen Breyer said of his female peers at Harvard Law School in the early 1960s.