How do you balance travel and getting good shots? Do you bring a compliment of lenses or a travel lens set?

Currently I just bring my 60D, 24-105, and then 10-18. Sometimes I miss some macro shot, long range shot, etc that if I brought all my lenses I coulda had. At the same time I don't want to have to walk around all day with 4 extra lenses and shit on vacation and have to plan my day around photography.

I'm going to Italy for 10 nights in 2 months and plan to just bring the kit mentioned above, get up one day early to take some nice shots at sunrise in each city I go to, scouted a few and wrote down some ideas, and then snapshot the rest.

Anyone else do more? How do you manage walking around with all the gear and shit? It sucks having to bring a camera bag around into restaurants, etc.