XFileSharing Pro - Disk I/O low performances

Message
Author
traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

Disk I/O low performances

#1 Postby traqck » Dec 22, 2012 7:03 pm

Hello !

When I have like 200 people downloading at the same time on the same server, even though I have a 1gbps link on the server, people are complaining about low speeds (it's not the connection to the server, maximum out is about 500mbps).

Nginx has been installed by the sibsoft team and disks set up in RAID10.

Here are some infos;

# hdparm -ftT /dev/sda3

/dev/sda3:
Timing cached reads: 5580 MB in 2.00 seconds = 2790.64 MB/sec
Timing buffered disk reads: 36 MB in 3.54 seconds = 10.18 MB/sec

Disks are SATA2.

Do you think the bottleneck is the hard disks ? How can I enhance that ?

frostyshield
Posts: 52
Joined: Nov 26, 2012 9:58 am

#2 Postby frostyshield » Dec 22, 2012 10:03 pm

what are your hard drives? I mean all the info make, model, speed, capacity, raid 10 should be giving you a big performance increase so I dont think its your hard drives try running chckdisk

traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

#3 Postby traqck » Dec 23, 2012 12:47 am

The server is equipped with ;

1x Hitachi HDS723020BLA642 (2011)
3x Seagate ST2000DM001 (2012)

User avatar
PilgrimX182
Posts: 2186
Joined: Mar 22, 2006 1:39 pm

#4 Postby PilgrimX182 » Dec 27, 2012 4:43 am

I can try to tune your nginx settings a bit, create a ticket in our system with ssh root details, will take a look.

I think it's RAID slows down random disk seeks. Cause have to reposition HDD reading head on each file chunk requests. Single disks shows much better perfomance, with only lack of data safe guarantee.

traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

#5 Postby traqck » Dec 27, 2012 4:43 pm

Done. Thanks ! :)

upmaster
Posts: 16
Joined: Jan 02, 2012 10:31 pm

#6 Postby upmaster » Dec 27, 2012 8:05 pm

traqck wrote:Done. Thanks ! :)
What helped ? How disk performance looks now ?


Thanks.

traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

#7 Postby traqck » Dec 27, 2012 8:51 pm

"Done" >> i've sent the root login details to the sibsoft team ;)

upmaster
Posts: 16
Joined: Jan 02, 2012 10:31 pm

#8 Postby upmaster » Dec 28, 2012 3:43 pm

Ok, post more info about your sever, disc configuration (i.e 2x2TB), software or hardware raid, have you got access to raid controller settings ?

traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

#9 Postby traqck » Dec 28, 2012 8:54 pm

This fileserver is an ;

Intel Core i3 2100
32GB RAM
4 x 2TB HDD Hard RAID10
1Gigabit Uplink

Nope, don't have access to any hardware raid settings.

Sibsoft told me a few hours ago that they managed to tune the nginx settings but still the speeds are slow, so I wrote them back and I'm waiting for a reply.

Will tell you more asap.

trinsic
Posts: 149
Joined: Dec 21, 2009 9:24 am

#10 Postby trinsic » Dec 28, 2012 11:56 pm

Do you have a dedicated GBit link or an unmetered one? If you're not paying minimum $500 a month then you don't have a Gbit link and you can likely only burst it for short amounts of time and average 300-400MBps.

upmaster
Posts: 16
Joined: Jan 02, 2012 10:31 pm

#11 Postby upmaster » Jan 07, 2013 7:27 pm

So, how it is going now ?

Did sibsoft helped ?

traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

#12 Postby traqck » Jan 07, 2013 10:42 pm

Yup.

I think the problem is not the server, performances are good. The problem is the uplink; they limit bandwidth during the evening so the server can't use full 1gbps uplink. Switching to an unmetered 1gbps dedicated line soon ;)

upmaster
Posts: 16
Joined: Jan 02, 2012 10:31 pm

#13 Postby upmaster » Jan 07, 2013 11:08 pm

Sounds bad, who is your server provider ? leaseweb ? Make you sure if it is really bandwith problem, also post some info how bad download speed are, including premium and free users.

traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

#14 Postby traqck » Feb 01, 2013 10:36 am

Sorry for the late answer !

Now I've moved to a new server with an unlimited dedicated 1gbps line but still speed is about 1mo/s for premium, not higher... What could be done to enhance that ?

traqck
Posts: 26
Joined: Sep 25, 2012 4:46 pm

#15 Postby traqck » Feb 02, 2013 2:27 pm

here are atop results from new server;

Image

Seems to have a pb with the HDD.

Very low speeds when downloading, even in Premium.

When i direct download from the server, without going through XFS, i get really good download speeds.


Do you think it's normal results for 4 x 3to brand new HDD set up in RAID 10 ?
Do you think adding 8Go or 16Go or RAM will enhance the perf ?