jDownloads Support Forum

Older Versions => jDownloads 3.2 (Support ended) => General => Topic started by: zzzzk on 03.03.2016 22:50:57

Title: Quick Question - Why need to block crawlers, search?
Post by: zzzzk on 03.03.2016 22:50:57
Hello, quick question.  You have the option to block crawlers, search engines. You also have the option to use a recaptcha.  I can see the need for this in user registration or forms.  (spammers or false accounts).   However, why would this be needed for jdownloads for files such as music or docs?  Do crawlers, search engines actually download the files? Is it needed for security?  Thank you :-\
Title: Re: Quick Question - Why need to block crawlers, search?
Post by: ColinM on 05.03.2016 10:33:08
Hi
There maybe many reasons why you want to block crawlers from indexing your Downloads. The three principle reasons are privacy, security, and excessive traffic.
Most people do not block the crawlers but there are some 'bad' ones.
The following article might be helpfull
http://blog.kualo.com/understanding-and-controlling-web-crawlers-and-bots/

Colin
PS I meant to edit this post to correct a spelling error but mistakenly clicked on the wrong one