Where do you draw the line between "these new hiking boots are still breaking in, give it some more time" and "these boots just aren't going to work"?

I just got in from a quick 3 mile hike and my feet generally just hurt with small blisters on my little toes. I've probably got 30-35 miles into these boots almost all in 2-3 mile increments. I pushed it once and did a 7 mile hike but walked barefoot the last mile. At that time, I figured it was too much too soon and just needed more break in. Not so sure anymore. Starting to think they just don't agree with my feet. Have you ever given up on a pair of boots?

Oh, and those are not my nasty feet.