The definition of the word Whit is: the smallest part or particle imaginable. In the poem the boy is saying that the Baltimorean was not the smallest part or particle imaginable bigger than him. So basically both the boy and the Baltimorean are the same size.
Infomation found at: http://www.m-w.com/cgi-bin/dictionary