In short, it means that however hard this man tried he could not enjoy all the Majority did.  He was not as others were. A common spring, is a poetic way of saying he didn't like what maybe his friends or family did.
      Because of this and many other things Poe was considered an oddball to himself and others during his life.  See he biography for more!