XFileSharing Pro - server overload 150%

Message
Author
geekev69
Posts: 45
Joined: Dec 05, 2009 6:12 am

server overload 150%

#1 Postby geekev69 » Jan 09, 2010 12:43 am

Hello guys

Im just getting daily 3000UV to my site for 2 days and today server overload 150% and finally down lol....
Im getting this message as well
-----------------------------------------------------------------------------
spamd failed @ Fri Jan 8 18:57:17 2010. A restart was attempted automagically.
Service Check Method: [check command]

Cmd Service Check Raw Output: Spamd is not running
-----------------------------------------------------------------------------

3k uv is just small traffic...
what should I do?

GMC
Posts: 172
Joined: Aug 15, 2009 4:48 am

Re: server overload 150%

#2 Postby GMC » Jan 09, 2010 6:32 am

geekev69 wrote:Hello guys

Im just getting daily 3000UV to my site for 2 days and today server overload 150% and finally down lol....
Im getting this message as well
-----------------------------------------------------------------------------
spamd failed @ Fri Jan 8 18:57:17 2010. A restart was attempted automagically.
Service Check Method: [check command]

Cmd Service Check Raw Output: Spamd is not running
-----------------------------------------------------------------------------

3k uv is just small traffic...
what should I do?
I would suggest a second server to share the load

Its what I did

geekev69
Posts: 45
Joined: Dec 05, 2009 6:12 am

buy

#3 Postby geekev69 » Jan 09, 2010 8:00 am

buy new server even before getting profit?

I think this is not the right answer indeed...

naga
Posts: 45
Joined: Dec 22, 2008 3:40 pm

#4 Postby naga » Jan 09, 2010 3:13 pm

-> what kind of server do you have?
-> spamd is used for mailservers, I don't think it has anything to do with xfilesharing
-> You probably use apache for serving files, consider using lighttpd or nginx
-> go in a ssh terminal and type 'top' . it will show you what processes are using the resources

GMC
Posts: 172
Joined: Aug 15, 2009 4:48 am

Re: buy

#5 Postby GMC » Jan 09, 2010 11:07 pm

geekev69 wrote:buy new server even before getting profit?

I think this is not the right answer indeed...
LOL - you may have an unreal expectation from this script

Good luck with your load issues

geekev69
Posts: 45
Joined: Dec 05, 2009 6:12 am

#6 Postby geekev69 » Jan 10, 2010 5:49 am

naga wrote:-> what kind of server do you have?
-> spamd is used for mailservers, I don't think it has anything to do with xfilesharing
-> You probably use apache for serving files, consider using lighttpd or nginx
-> go in a ssh terminal and type 'top' . it will show you what processes are using the resources
Hey naga, do you know how to install lighttpd and nginx?
I need help. I will pay for it.
please talk to me when you check this.

msn : [email protected]
ym : ssdynamite

admin
Site Admin
Posts: 1839
Joined: Mar 22, 2006 12:32 pm

#7 Postby admin » Jan 10, 2010 11:12 am

naga wrote:-> what kind of server do you have?
-> spamd is used for mailservers, I don't think it has anything to do with xfilesharing
-> You probably use apache for serving files, consider using lighttpd or nginx
-> go in a ssh terminal and type 'top' . it will show you what processes are using the resources
Completely agree with naga

There's nothing to be done with script if spamd is causing load (need to take a look at "top" output).

Also, geekev69 used non-direct download links (via dl.cgi) for downloads - that's not the best way. We always suggest to use direct links in order to avoid such problems.

Hendrickson
Posts: 90
Joined: Nov 18, 2009 9:15 pm

#8 Postby Hendrickson » Jan 10, 2010 12:33 pm

Hi I'm not using direct links either, only for premium users. Wont using direct links bypass the download speed limits? So everyone will then be downloading like a premium user. Kinda defeats the purpose?

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#9 Postby PilgrimX182 » Jan 11, 2010 11:24 am

Sending through dl.cgi with limited speed takes lotta CPU. Use direct links instead, they gives lowest load under apache.

Hendrickson
Posts: 90
Joined: Nov 18, 2009 9:15 pm

#10 Postby Hendrickson » Jan 11, 2010 11:36 am

PilgrimX182 wrote:Sending through dl.cgi with limited speed takes lotta CPU. Use direct links instead, they gives lowest load under apache.
Its true my load went from 10.00+ to now sitting at 0.40 using top on apache 2.2. But how do we then limit anon users and reg users speed so Premium users get the faster speeds? Also using direct links has given me no premium account sales.....since I turned it all for all users.

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#11 Postby PilgrimX182 » Jan 11, 2010 11:45 am

It's up to your marketing team to decide how to monetize your site.
But check for different download/upload limits for different user types.
To give premium best speeds it's good idea to buy extra server and start Premium-only FS there. So free users will suck only from free overloaded server, but who cares, premiums won't be affected.

Hendrickson
Posts: 90
Joined: Nov 18, 2009 9:15 pm

#12 Postby Hendrickson » Jan 11, 2010 11:52 am

PilgrimX182 wrote:It's up to your marketing team to decide how to monetize your site.
But check for different download/upload limits for different user types.
To give premium best speeds it's good idea to buy extra server and start Premium-only FS there. So free users will suck only from free overloaded server, but who cares, premiums won't be affected.
Thanks for the tip, concidering my sites running at a loss each month still the option to buy a server for premium only users is a distant future one I guess. But i'll keep it in mind.

GMC
Posts: 172
Joined: Aug 15, 2009 4:48 am

#13 Postby GMC » Jan 11, 2010 11:48 pm

PilgrimX182 wrote: To give premium best speeds it's good idea to buy extra server and start Premium-only FS there. So free users will suck only from free overloaded server, but who cares, premiums won't be affected.
Doesnt work really

Only if a Free user downloads a free user file and premium users download premium files

if a Premium user download a free user file he will still get the crap download speeds due to the overloaded server

and a free user downloading a premium file will get sensational speeds due to the free resourced server

But at least its something!

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#14 Postby PilgrimX182 » Jan 12, 2010 10:56 am

GMC, this make sense, thanks!

naga
Posts: 45
Joined: Dec 22, 2008 3:40 pm

#15 Postby naga » Jan 12, 2010 11:21 pm

geekev69 wrote: Hey naga, do you know how to install lighttpd and nginx?
I need help. I will pay for it.
please talk to me when you check this.
Hi I think you're better off getting the nginx package from the support, since with lighttpd or nginx you still need apache to handle the file uploads and cgi work

I made a modification for my own site that handles all this but it's kinda sloppy.
for those interested;
-> cgi stuff goes via apache2
-> normal downloads are via lighttpd with 2 conns per ip per server on port 81
-> premium downloads are via apache2 with no limits on port 80. This is done by using the $premium in the link generation, using a htdocs & htdocs_premium line.
The advantages of this are that premium users get a better speed already via apache2, if lighttpd gets overloaded(which it hardly ever gets) premium users can still download. file uploads and link generation continue to work on a overload