In Which Google Indexes Your Cat

So Google recently had a nifty idea: Have photo vans drive around major cities taking about a bazillion panoramas, then put the results on Google maps, allowing people to do a virtual walkthrough of the area. But, as with pretty much all of Google's ideas, there are worries about privacy.

I think Google is within the bounds of the law on this one. Taking photos in public places is legal. The question is whether combining public images can turn them into a violation of privacy. (Should it? Does this mean changing our definitions of "public" and "private"?)

A related question: Do people have the right to not be unpleasantly surprised by technology?