XFileSharing Pro - Help!!

[sunny]

Hey Guys!! I'm going to start file hosting mainly audios files with xfilesharing pro script, please tell me is 1 server is enough for my site?

Check Server Specs Below:(From Leaseweb)
Intel Dual-Core G6950
4gb ddr3
4tb sata2
centOS 6

In Future I'm upgrade It If My Site Grow actively, now i'm only clarify is this server is good for start?

Thanks