This article will describe how to configure your robots.txt in such a way so as to prevent bots from hammering...