Overview of content related to 'higher education' http://www.ariadne.ac.uk/taxonomy/term/15918/all?article-type=&term=&organisation=&project=&author=ian%20peacock&issue= RSS feed with Ariadne content related to specified tag en Showing Robots the Door http://www.ariadne.ac.uk/issue15/robots <div class="field field-type-text field-field-teaser-article"> <div class="field-items"> <div class="field-item odd"> <p><a href="/issue15/robots#author1">Ian Peacock</a> explains how web robot access to your site can be controlled.</p> </div> </div> </div> <h3 id="What_is_Robots_Exclusion_Protocol">What is Robots Exclusion Protocol?</h3> <p>The robot exclusion protocol (REP) is a method implemented on web servers to control access to server resources for robots that crawl the web. Ultimately, it is up to the designer or user of robot-software to decide whether or not these protocols will be respected. However, the criteria defining an <i>ethical</i> robot includes stipulation that a robot should support REP.</p> <p><a href="http://www.ariadne.ac.uk/issue15/robots" target="_blank">read more</a></p> issue15 tooled up ian peacock ukoln university of bath niss authentication higher education html passwords perl privacy search technology software standards url web services Mon, 18 May 1998 23:00:00 +0000 editor 489 at http://www.ariadne.ac.uk