The point of a Silverlight policy file

When I began writing a file upload control in Silverlight I was surprised to learn that any computer I tried to establish a socket connection had to be serving a policy file. It seemed a bit ridiculous to me at first...