XUpload - Large File Uploads Fail

Message
Author
soc
Posts: 4
Joined: Feb 18, 2007 3:56 pm

Large File Uploads Fail

#1 Postby soc » Feb 18, 2007 4:46 pm

- Script type: Free Version 2.6
- Browser: IE
- OS: Linux
- URL to upload_form.html: http://www.eps-clan.com/upload_form.html

Hi,

Ive installed Xupload Free and everything has worked fine to an extent. Ive uploaded files around 200MB without a problem. But on large files around 700MB the script stops uploading near 50%, and the 'upload failed' message appears.

My concern is that the problem isn't the large file. I have a blazing 750KB/Sec upload speed so I'm thinking it just takes a large file for me to encounter this problem. My site's users will be uploading 30MB-ish files, but those with slow uploads could easily get the same error on a much smaller file.

The temp file simply stops updating and my upload speed never drops to 0. I have the .htacces file on my server, not sure if this a timeout problem or script error.

Thanks for the help

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#2 Postby PilgrimX182 » Feb 19, 2007 12:26 pm

Strange problem for Linux server.
Try to change 15 to 60 in upload_status.cgi in this line:

Code: Select all

if($curr_time-$modif_time>15)
but don't think this would help.
I've been uploading file with your script up to 6 minutes and no problems. Make sure you have enough Free space for uploading big file.

soc
Posts: 4
Joined: Feb 18, 2007 3:56 pm

#3 Postby soc » Feb 19, 2007 5:30 pm

I tried changing that line to 60 on my own a couple days ago, and like you said it didnt work. It just took longer for the 'upload failed' message to appear after the temp file's size stopped increasing. But what's strange is my upload speed still continues normally and fluctuates during that 60 seconds...

I usually have to upload for 10 or more minutes for it to fail. But some of my users will be uploading for hours, since they'll be uploading large videos on slow connections. Ive only used 27% of my 100GB of web space.

I'll try uploading on my other PCs and see what happens. Also I previously made some superficial changes to the script, like taking out the checkboxes. There's a slight chance I maybe changed something I shouldn't have, so I'll try the original scripts again.

---------

Update: I tried uploading on a different computer, same result. I uploaded the original unedited script and still encountered failure.

Screenshot: http://www.eps-clan.com/failed.PNG

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#4 Postby PilgrimX182 » Feb 20, 2007 6:58 am

You get this problem in IE only? Try in other browsers.
What Apache version? Update your CGI perl module.
Set 'TimeOut' variable to 6000, 'KeepAliveTimeout' to 120 in Apache config httpd.conf.

soc
Posts: 4
Joined: Feb 18, 2007 3:56 pm

#5 Postby soc » Feb 20, 2007 2:28 pm

I'm currently testing in Firefox and Opera, so I'll see how that turns out. I'm on shared hosting so I have no control over perl modules. But my server has always been great about keeping up-to-date on modules for perl, php, etc.

As I said, Im on shared hosting so I don't have access to httpd.conf. But I can probably change those variables through .htaccess, I'm just not sure how to do that.

Update: Failed in both Firefox and Opera.

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#6 Postby PilgrimX182 » Feb 20, 2007 3:19 pm

Can you try to upload this big file with simple PHP script?
Maybe it's your hosting limitation? Ask their support.

soc
Posts: 4
Joined: Feb 18, 2007 3:56 pm

#7 Postby soc » Feb 27, 2007 4:46 am

It seems my host had some sort of restriction on cgi scripts...

So I switched hosts and now the uploader works great even on HUGE files. Thanks for the great help :)

sandyinc
Posts: 7
Joined: Dec 15, 2006 8:30 pm

#8 Postby sandyinc » Mar 08, 2007 3:44 pm

I'm having a similar issue with mine. The timeout variable in the Perl module is set as:
$TIMEOUT = 240*60; # 4 hour timeout for big files
Should this be set to a static number instead of a calculation?

I set the timeout in Apache to a ridiculously high number (100000 or so).
I can never get a complete answer from the users (It just didn't work. I got a white screen. It failed.) so I don't know whats happening with them.

I just tested transferring a 696MB ISO file from cable to T2 a couple times and its all over the place. The shortest failed out just after 4 minutes, the longest at 00:16:59. (and no white screens) The drive has 280GB to spare, so its not that.

Is there a way to get a better error message than "Upload failed!", perhaps in an email to the sysadmin?

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#9 Postby PilgrimX182 » Mar 09, 2007 6:37 am

If you have latest Pro version, you can try AJAX mode.
I'm not clear with your current problem. Actually have no idea what "$TIMEOUT = 240*60;" is.
"Upload Failed" message showing when size of temp file not increasing for 15 seconds. Did you try to increase this time as I suggested above?
What browser are you using? IE? Try to upload in different browsers.

sandyinc
Posts: 7
Joined: Dec 15, 2006 8:30 pm

#10 Postby sandyinc » Mar 09, 2007 3:35 pm

I tried increasing the timeout to 60 seconds, but its still random. I've been testing with Firefox mostly, but also IE and Safari.

I'm starting to think it might not be the software, but I need to be sure.

I'm using version 2.5, is that the latest with AJAX mode?

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#11 Postby PilgrimX182 » Mar 12, 2007 12:30 pm

It's not xupload problem, but server software problem.
Or upload fails at some time Or temp file stops populating. I don't know why. Probably there are restrictions on memory or CPU used by script.
Try on another server.

Ajax mode present on latest Pro 2.4 version. It helped to solve some upload problems on IE cause it's not required persistent connection for updating progress.

Max
Posts: 5
Joined: Jun 04, 2008 7:32 pm

#12 Postby Max » Jun 05, 2008 9:28 pm

Hi, I am using Free xupload version 2.6.
Have to say that this is the best upload script that I could find for now.

But I have problem uploading big files with IE6 or IE7. It works OK with file size ~ 1.44MB but it fails at ~64MB files. Upload fails at some point and it is not a specific time since starting the upload. I've tried different hacks from the forum and it did not help. All the other browsers can handle files up to 100MB.

Are you aware of any other issues with IE that could cause upload failure?
I using the script on a Linux server with Apache, and testing it on win XP Pro.

Thanks in advance.

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#13 Postby PilgrimX182 » Jun 06, 2008 5:22 am

Please describe how it fails. You see Upload Failed message or it's just progress bar freezes. If you wait some time, upload is not completing?
Make hidden iframe visible, do you get any error there when fails?

Max
Posts: 5
Joined: Jun 04, 2008 7:32 pm

#14 Postby Max » Jun 06, 2008 7:18 am

Thanks for the reply.
I do not see any error messages.
When I try to upload 60MB file in IE, at ~75% upload progress jumps to 100% and I have this:
Image

When I try to upload 104MB file in FF, upload progress freezes at some point and I get this:
Image

In both cases if I wait it does not continue. No redirect happens and no files uploaded.

My iframe is not hidden, and I do not get any errors when upload fails.

Any ides?
Thanks

Max
Posts: 5
Joined: Jun 04, 2008 7:32 pm

#15 Postby Max » Jun 09, 2008 7:24 pm

Hi,
Are there any updates on my problem?
I am desperately trying to make it work with files up to 110MB
Thanks in advance.