From an evolutionary point of view it probably means you have adapted to prefer more submissive girls. There is a well known correlation between breast size and aggressive personality. While breast size also signals fertility, specifically the ability to feed a child well, it has its drawbacks since it also signals the female is more likely to be unfaithful. Those people who are attracted to smaller breasts presumably have evolved to prefer the safer, more homely woman over the fitter woman is is also more likely to cheat.
From Ed Dutton's book:
>I have found one academic study which summarises research looking at the relationship between ornament size and personality (Steiner, 1980). It notes two key studies, both unpublished conference presentations by the American psychologist Nancy Hirshberg (1937-1979), who unfortunately seems to have been taken very young, and her colleagues. In these studies, the 144 subjects were female students at the University of Illinois. Large breast size was found to be significantly positively correlated with being ‘undersocialized’ (that is, antisocial), undependable, impulsive, ‘psychologically minded’ (that is introspective), flexible and adventurous. So, to some extent, the larger a woman’s breasts are the lower in Conscientiousness she is, the higher in Extraversion she is and the less Agreeable she is.
Steiner, I. (1980). Attribution of choice. In Fishbein, M. (Ed). Progress in Social Psychology, Volume I. Psychology Press.