>>313654http://en.wikipedia.org/wiki/Sensory_systems_in_fish#HearingIt's actually pretty damned interesting and worth the read. TLDR - They do have "ears" as well as their "lateral line" which can detect sound/vibrations. Pic related for lateral line. Hair cells either on the surface or sub-dermal run along the line and transmit vibrations to the fish's nervous system. Helps them to swim in schools, orient themselves toward prey, etc.
>>313661Also noteworthy. I imagine it isn't too much of an issue but if you're line were taught and you had your rod/reel against your chest as you spoke it could probably carry sound into the water. Much like making a "phone" out of a couple of cans and some string.
Whether or not you're gonna scare the fish away is up in the air. Some fish are skittish about noises and some are drawn in by sound (think lures like poppers, jitterbugs, etc). I usually play it safe and try to stay quiet, not in terms of talking but in regard to my point(s) of contact with the water. When wading or fishing from rocks I walk softly. When on the jon boat I throw a blanket down in the middle so dropped gear doesn't resonate through the hull.