Waz-Warez LinkBot

[smoky]

awsome script gavo top man for the shear bro.

any chance you know how i can get it to post on the thread the the topic was checked on e.g (24/04/2010-at 9pm) or somthing like that

[smoky]

I'm using this and it's working nicely.
The only problem I'm having is that it skips a very large amount of threads saying:

http://hd-dump.org/viewtopic.php?&t=75
No  Download Links or Already Binned

Although these threads clearly DO have links and haven't been binned.

Any ideas?
I think it's skipping around 80% of my threads.
Also, another question.
How can I tell the linkbot to recheck threads that it's already checked in the past? The only way I see is to delete the content of the checked_topics table in mysql.
Is there any other way?
Also, is there a way to define a % of dead links to which to decide to trash the topic, like 90% or something.

Thanks

try

1. $stag="<code>";
2. $etag="</code>";

or

1. $stag="<div class="codecontent">";
2. $etag="</div>";

[Gavo]

I have made a new version thats x20 faster... but only check rapidshare.com

http://pastebin.com/kvN2dhPZ

only 2 edits needed

[Smith]

I have made a new version thats x20 faster... but only check rapidshare.com

http://pastebin.com/TVcMVmWR

only 2 edits needed

Can you add other hosts such as mediafire, megaupload, hotfile etc.? Much appreciated

[McGrhill]

Can you add other hosts such as mediafire, megaupload, hotfile etc.? Much appreciated

I guess he is already trying tht.

[Gavo]

I would prefer to check links by API for diferant hosts to keep the speed up and not get IP banned but will check with other hosts.


It has checked 22k topics in 1 hour

[Smith]

I would prefer to check links by API for diferant hosts to keep the speed up and not get IP banned but will check with other hosts.


It has checked 22k topics in 1 hour

Really nice, you should tune, make it more user friendly and submit it to phpBB(dot)com

[The Chief]

thanks gavo second script is way better

[Lock Down]

I have not seen your script but if you are using code tags that may not be the best way.

Scanning the forums for the api types ('%rapidshare.com/files/%' or post like '%hotfile.com/dl/%' or post like '%megaupload.com/?d=%'
or post like '%filefactory.com/file/%' or post like '%freakshare.net/files/%') is a safer way of getting the links only then using regex to be sure it is a file link.

It used to take 8 hours to scan 100K posts but now 13 minutes. Gav0 is correct in dropping the curl one link at a time.

[Mr Happy]

I would prefer to check links by API for diferant hosts to keep the speed up and not get IP banned but will check with other hosts.


It has checked 22k topics in 1 hour

The only other host that I know of that has an API that you can check links is SendSpace and it's in Beta. It would be really cool if the other big file hosts added an API as it's much faster.