CurlAxel - PHP file download accelerator

**jokerhacker** · 27th Aug 2011, 03:39 PM

hey, i thought many people will like that.
I just wanted to help, so this PHP class may help some people who need it.
it's not a script, neither a software, it's a class used by developers to be integrated in their scripts.
How about cookies, proxies and other curl option??
well, everybody know curl_setopt_array(), you need to create an array, put all your configs there and pass it to the class using
setCurlOpts(). But keep in mind, these settings will be overwritten:

CURLOPT_RETURNTRANSFER
CURLOPT_FOLLOWLOCATION
CURLOPT_BINARYTRANSFER
CURLOPT_FRESH_CONNECT
CURLOPT_CONNECTTIMEOUT
CURLOPT_FILE
CURLOPT_RANGE

Included Functins
this is a list of function made in the class

activeLog() - true or false - to desactivate activate log - log file is created in tempdir
setUrl() - sets the url to download
setParts() - number of connection (parts) to be created
setCookies() - set the cookies string to be passed with the curl request
setTempDir() - must be absolute parth, if not found, it will be created
setProgressCallback() - enable progressbars
setDownloadDir() - must be absolute parth, if not found, it will be created
setCurlOpts() - this is the function allowing you to set your cookies, proxies and other option as an array of curl options.
getFileSize() - you may use it to get the file size of a url
isMT() - check if the given url supports multithreaded connection
download() - the most important function lol
slow_download() - force CurlAxel to download file using 1 connection
fast_download() - force CurlAxel to download file using multiple connection

Version
curent version is 0.5 30/10/11
still have lots of work to do, but i need your feedback!

Example how to use it
It's pretty simple!

PHP Code:


$fileurl = "++ url here ++";

$curlaxel = new CurlAxel;

$curlaxel->setUrl($fileurl);

$curlaxel->activeLog(true);

$curlaxel->download();

and you will get your file with the fastest speed ever

Want to see progressbars?
It's pretty simple! (see test.php also)

PHP Code:


<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">

    <head>

        <script src="js/jquery.js"></script>

        <script src="js/jquery.progressbar.min.js"></script>

    </head>

    <body>

<?php

ini_set('error_reporting', E_ALL);

ini_set('display_errors', 1);

include 'CurlAxel.php';

//$fileurl = "http://cachefly.cachefly.net/100mb.test";

$fileurl = "http://93.190.137.8/1000mb.bin";



echo "downloading $fileurl <br>";

$curlaxel = new CurlAxel;

$curlaxel->setUrl($fileurl);  

$curlaxel->setProgressCallback(); 

$curlaxel->setBufferSize(32*1024*1024);

$curlaxel->activeLog(true); 

$curlaxel->download();

to use the progress bar, you need to integrate jquery and jquery progressbar plugin into your page. Here is what to do:

Code:

<head>
	<script src="js/jquery.js"></script>
	<script src="js/jquery.progressbar.min.js"></script>
</head>

I'd like to see people using this and providing feedback, if you see an error just activate the log and make a reply here, or contact me directly.
pleas keep it away from commercial use.

Special thanks to CuraHack who motivated me and gave me a great development environment

changelog
version 0.5 30/10/11

improved link checking method
added 100% working detailed progress bar (see docs for more infos)
some code cleanup

version 0.2 16/10/11

added support for various server responses
fixed filesize issue when requested server doesn't allow download accelerating
added support for cookies (passed as string)
added support for standard curl progress callback functon

version 0.1 29/08/11

small bug fixes
added GNU GPL 3 licence

version 0.1b beta 27/08/11

added optional buffersize to merge files. can be set though setBufferSize (in bytes).the default buffersize is 64Mb

version 0.1a beta 27/08/11

updated useragent choice as Robin H requested. now mozilla is the default user agent, but can be changed using user curl options array

Download
http://github.com/JokerHacker/CurlAxel

jokerhacker Reviewed by jokerhacker on 27th Aug 2011. CurlAxel - PHP file download accelerator http://i28.lulzimg.com/e5b0e69371.png hey, i thought many people will like that. I just wanted to help, so this PHP class may help some people who need it. it's not a script, neither a software, it's a class used by developers to be integrated in their scripts. How about cookies, proxies and other curl option?? well, everybody know curl_setopt_array(), you need to create an array, put all your configs there and pass it to the class using setCurlOpts(). But keep in mind, these settings Rating: 5

**Robin H** · 27th Aug 2011, 04:37 PM

Noticed the useragent is just mozilla..
so why not let people decide which useragent they want to set?
And add error handling.

Anyway, nice piece of code.
That's one of the things I can delete of my 'I wanna code this:' list

edit:
This worry's me:

PHP Code:


<?php
...
$contents = fread($bh[$i], filesize($partpath));
...
?>

Doesn't it create massive memory usage when you download a (very) large file?
Not sure how PHP would handle it tho, just a guess.
Fix would be to do a while loop and only concatenate x mbyte at once?

But once again, very very useful class.

**jokerhacker** · 27th Aug 2011, 04:59 PM

updated useragent choice as Robin H requested. now mozilla is the default user agent, but can be changed using user curl options array

version 0.1a beta 27/08/11
http://www.mediafire.com/?vlaxavia2xdocs4

**Robin H** · 27th Aug 2011, 05:01 PM

Nice to see you're willing to work on it

And be sure to check out the concatenate issue.

You'll want to have something like this:

PHP Code:


<?php
...
        $finalpath = $this->downdir . $this->filename;
        $i = 0;
        while(file_exists($finalpath)){
            $finalpath = $this->downdir . substr($this->filename,0,-4) . $i . substr($this->filename,-4);
            $i++;
        }
        $final = fopen($finalpath, "a");
        $chunksize = 5 * 1024 * 1024; // 5MB, I have no idea what a decent amount would be
        for ($i = 0; $i < sizeof($this->splits); $i++) {
            $partpath = $this->tempdir . $this->partnames[$i];
            fseek($bh[$i], 0, SEEK_SET);
            while(!FEOF($bh[$i])){
                $contents = fread($bh[$i], $chunksize);
                fwrite($final,$contents);
                flush();
                fflush();        
            }
            fclose($bh[$i]);
            unlink($partpath);
        }
        fclose($final);
...
?>

The while loop that checks the filename and changes it in case it exists might not be necessary, but never hurts.
I also assume there is a 3 char extension, which you will need to verify first. ( might also been wrongfully done, I always fuckup with substr

)
I didn't test it myself.

**jokerhacker** · 27th Aug 2011, 06:11 PM

added optional buffersize to merge files. can be set though setBufferSize (in bytes).
the default buffersize is 64Mb
0.1b beta 27/08/11
http://www.mediafire.com/?5jhhdhftwgz3yr1

Thank you Robin H

**Gaurav** · 27th Aug 2011, 06:24 PM

Great work JokerHacker

**jokerhacker** · 27th Aug 2011, 06:37 PM

thanks gunda316, i'm glad to hear that from a Respected Developer

i'm fighting to get it under my username lol

**AV!X** · 28th Aug 2011, 01:12 AM

this guy is really brilliant !!!!

**CuraHack** · 28th Aug 2011, 01:21 AM

Double that, I really appreciate your work. +REP

Is it possible to integrate your script/code with Rapidleech?
http://www.besthostingforums.com/showthread.php?t=99087

Thank you!

**jokerhacker** · 28th Aug 2011, 01:42 AM

you can integrate it in any script you want

@Avix, thanks br0

CurlAxel - PHP file download accelerator

Thread Tools

Display

CurlAxel - PHP file download accelerator

Sponsored Links

Thread Information

Users Browsing this Thread

Similar Threads

download file???

Download Accelerator with Rapidleech

Why it's not download the file?

Which File host will count download with jdownloader or download manager?

Tags for this Thread

Posting Permissions

themaCreator - create posts from...

themaPoster - post to forums and...

themaLeecher - leech and manage...

themaManager - edit and manage...

themaCreator - create posts from...