How to prevent google from downloading?

[Amicus]

Hello.

I'm using jDownloads for some time and I'm very pleased.
I'm almost finished entire Bosnian translation.

But, I have one problem.
I'm using Joomla! 1.5.22, and jDownlaods V1.8.1.

In my download logs I can see wast of downloads by GOOGLE!
That downloads are also counted as regular.

How to stop counting  google (or other bots) liek regualr downloads?

In attachment you can find two images: one with list of IPs that made downlaod (from jDownlaods download logs) and
second is result of whois query that shows that IP belongs to google.

If you have any suggestion, please help.

As thank you I will post my Bosnian translation here as soon as I finish it (soon).

Thanx.

[Arno]

Hi Amicus,
at first: i have you added to the translation team. You see now a new internal forums category. 
Many thanks for your translation work.

About the bot problem:
- we can add a rel="nofollow" for the download link
- we can upload in the download root folder a robots.txt (sse http://www.robotstxt.org/robotstxt.html for informations)
or
- we must add a captcha field
The last option is not easy to add.

By the way, it seems that i have this problem not on my sites. But i will it check a little more.  

[Amicus]

Thank you for your reply.
I'm waiting for your solution.

I have one question. If I put robots.txt file in jDownloads folder, is it going to stop bots to enter that folder
or stop them browsing entire web site?

I wouldn't like to stop bots browsing entire site.

Thanx again.

P.S.

I'm posting unfinished translation and I'm working to finish it all.

[Arno]

I have one question. If I put robots.txt file in jDownloads folder, is it going to stop bots to enter that folder
or stop them browsing entire web site?

I think the robots.txt is not useful. Then this works only, when you deactivate the 'Send downloads over PHP Script?'.
But i am not sure in the moment.

Better way is to add a nofollow and a new option to use a simple (mathematical) human check.

[Amicus]

Those downloads made by google bot are only in category for all visitors (unregistered).

I have no google bot downloads in my other section for registered users.

That should mean something.

[Arno]

I have no google bot downloads in my other section for registered users.

Sure. Also the bots has no access to this categories.

[Amicus]

Hello.
I was wondering, if there any solution for my question?
I'm getting annoyed by this google spiders.
They are all the time all over the site.

They just increasing my download count.
Maybe they are attracted by meta information for downloads.

[Arno]

Hi,
please test the attachment file. Copy it over the original on your server.
Then check your logs for a view hours or a day.
Please post then your results here again.

[Amicus]

Hi,
please test the attachment file. Copy it over the original on your server.
Then check your logs for a view hours or a day.
Please post then your results here again.

Many thanx for your effort.
Last night I have copied your file and since now (about 12 hours later) i had only one google download.

I have to try to add new downloads to see if they are going to be downloaded by google bot.

For now it looks like you have found solution.

Thanx again.

I will keep you posted.

[Arno]

Ok, thanks for your results.
This was only a test.
I have only blocked the google bot ip adress. So it is not a final solution.
Perhaps can we add a new option, where the user can add ip adresses from bots.
Better is, when i add as default know ip adresses, but i have not the time to search for it in the net.
Can you help me by this? Perhaps exists anyplace a list...    

I will not insert a captcha to block the bots. This is not good for the users and to much work for me in the moment.

[Amicus]

Did you block google bot only from accessing the download?

You have asked for some list of bots IPs. So I have extracted IPs from my MySQL database from my web site
and, in attachment, you can find some list of bots who visited my web site in this year.

I hope you can use it.

Lets others go through their databases and find some more.

An option for entering blocked IPs would be great.

Thank you for your help.

[Arno]

Did you block google bot only from accessing the download?

Yes, only the download is blocked. The bot is moved to a other site when he will download a file.

Many thanks for your list. I will try it and i hope i can fast add this new option.

[Amicus]

I have red some article about manipulating with web spiders.
If you serve web spider different content then it actually is on your web page,
then, search engine can remove your site from all their results.

Can it be problem with this?

You said that you are redirecting it to other site.

[Arno]

Hi,
it is current (in your changed script) only moved to a site in your jDownloads with a message, that he has not the access rights to download this file.
So i think it is not a problem... 

[Nightmare4k]

Hi
I can see in the file the ip that is blocked is 66.249.71.36
The ip´s i will like to have blocked is
66.249.66.171
66.249.66.206
66.249.71.40
66.249.71.34

How do i do that?