Email this page to a friend

Standard for robot exclusion

<World-Wide Web> A proposal to try to prevent the havoc wreaked by many of the early World-Wide Web robots when they retrieved documents too rapidly or retrieved documents that had side effects (such as voting).

The proposed standard for robot exclusion offers a solution to these problems.

(http://info.webcrawler.com/mak/projects/robots/norobots.html).

< Previous Terms	Terms Containing standard for robot exclusion	Next Terms >
stand-alone standard Standard Commands for Programmable Instruments Standard d'Echange et de Transfert standard deviation	spider standard for robot exclusion	Standard for the exchange of product model data Standard Generalised Markup Language Standard Generalized Markup Language standard input/output Standard Instrument Control Library