|CSE Home||About Us||Search||Contact Info|
Building or using a web crawler is a dangerous business. As past students
(and their instructors / advisors / department chairs and university
presidents) have learned all too painfully, a small design error or coding
bug can causes a crawler to hammer a website with thousands of requests in
a short period of time.
To a webmaster, this looks like a Denial of Service Attack.
Even mild versions of this type of crawler behavior can get some touchy web masters very upset. In the recent past it has lead to email to numerous faculty, department chairs and even state officials. It has led to serious embarrassment for the advisor of at least one student. This faculty member would have preferred that the University President didn't know his name.
How do you think the professor felt towards his student? What grade do you think the student got?
Since I don't like angry emails, I insist upon extremely careful design and operator of all web software written for this course. In particular, I want you to do the following:
Department of Computer Science & Engineering|
University of Washington
Seattle, WA 98195-2350
(206) 543-1695 voice, (206) 543-2969 FAX