Need Advice with Synchronizing File servers

FireFox · Post by **FireFox** » Fri Mar 13, 2009 12:35 pm

In a nutshell

How would I go about running two file servers in different locations but have the data on them Synced with one another but not cost me to much data traffic?

File Server:
PC dedicated for storing all our draft documents, templates, ect.
Total file size = 800mb
Master Templates can be trimmed down too maybe 200mb

Internet limitation: most likely at both offices
ADSL 384kbs
3gb Cap

The data is obviously confidential and must be kept secure at all times from 3rd parties

As far a possible this should be DIY and not cost me a fortune or better yet nothing

If you all need more info just ask, I didn't want to bore the living crap out of everyone with all the details of the setups, plans and what-have-you-not

Basically we are opening a branch office and need our data synced between the offices, if possible at all times or as periodically as possible with the limitations set above.

Thanks alot

fliptw · Post by **fliptw** » Fri Mar 13, 2009 2:56 pm

which OS are these servers running?

FireFox · Post by **FireFox** » Sat Mar 14, 2009 1:53 am

The Server is running XP Pro and the server that I still need to setup I was also planning on running XP Pro. I do have a copy of Windows Server 2003 but I have no experience with that OS so I opted to go with XP back when I set it up as I was crunched for time

FireFox · Post by **FireFox** » Sat Mar 14, 2009 5:46 am

The bloke at the PC shop in town told me I might want to look into Open VPN. As I understood him I can setup a VPN for the two servers to periodically check the content of each other and just update the files that changed. (Oh yes the ADSL we use have Dynamic IP's) If that is so that would do the trick but I am a total noob with VPN, all I know is that it stands for Virtual Private Network if I'm not mistaken?

I'm willing to learn but I don't want to have to take an MIT course on it either

This sparked another topic of a FTP server. We have a website with 1gb storage space and in the end I would like our template documents to be available anywhere we go and have internet access to login and work on it. Would I be able to setup a FTP on the website space and have it also sync it with one of the file servers say on a weekly basis? If so that would work ideally for a backup system too.

PS the servers are setup to backup the documents on a second HDD everyday

But the FTP can be a backup to the backup

akula65 · Post by **akula65** » Sat Mar 14, 2009 7:58 am

In the Unix/Linux world, you would probably be using rsynch in conjunction with other software:

http://en.wikipedia.org/wiki/Rsync

There is apparently a way to build a Windows version with cwrsynch. You might want to have a look at that.

Gekko71 · Post by **Gekko71** » Sun Mar 15, 2009 4:09 am

Setting up FTP on your web server / web host is a cinch, any ISP should be able to take care of this (I recommend 1and1.com.) Automated FTP is a new one - though there should be an easy way to do it (smartFTP may handle it - which is free)

Once handy (and free) tool that may do part of the job for you is SyncToy 2.0 from Microsoft - you can download it from the MS website and it's pretty handy for combining / synchronising files under XP. No doubt there are other tools out there that could do the job just as well.

FireFox · Post by **FireFox** » Sun Mar 15, 2009 11:24 am

Thanks Gekko, yea SyncToy might just do the job I'm looking for. But correct me if I'm wrong or missing something.

If I were to setup the two servers (they will be 140km from each other btw

) I can use my portable HDD to just sync it with the one server then when I do my monthly visit to the other office I can take it with and then sync it over there then the HDD will have the complete synced content and would require me to just sync it again when I return to base

, bam content synced.

Well that will work perfect to sync the total content that would most likely size in over a 1gb big that would make doing it over the net a no no with my cap limit of 3gb

.

But would it be possible to say create a template folder which will be way less data on the servers and have it somehow linked/viewable over the internet and then us SyncToy that way? This is what I could gather from the bloke that talked to me about the VPN would do but alas I don't know if I would be able to setup a VPN.
[EDIT] Hamachi Well that looks easy enough? Basically I just setup this at both ends to the template folder with names like branch & base set a password and I would have access to the template folder? Then I can use synctoy and sync it? This would also then mean I can access it from anywhere were I have the client setup?[/EDIT]

In essence the templates are the only content of the servers that really needs to be synced but the possibility that it would change daily or within a month is slim making an online sync a bit of a bandwidth waste in retrospect

If something on the templates do change one can just email it to the other office with instructions to replace the file immediately that will result in the templates being synced without a major server setup and keeping things simplistic as well, complex setups tent to be way more of a problem when things go wrong.

Then also if I did setup a FTP with the templates you just need to do the FTP update simultaneously when mailing it to the other office. This will mean more of a \"manual labour\" approach then an automated setup but heck in theory this should do the trick right?

Gekko71 · Post by **Gekko71** » Mon Mar 16, 2009 2:57 am

FireFox wrote:Thanks Gekko, yea SyncToy might just do the job I'm looking for. But correct me if I'm wrong or missing something.

If I were to setup the two servers (they will be 140km from each other btw ) I can use my portable HDD to just sync it with the one server then when I do my monthly visit to the other office I can take it with and then sync it over there then the HDD will have the complete synced content and would require me to just sync it again when I return to base , bam content synced.

Well that will work perfect to sync the total content that would most likely size in over a 1gb big that would make doing it over the net a no no with my cap limit of 3gb .

But would it be possible to say create a template folder which will be way less data on the servers and have it somehow linked/viewable over the internet and then us SyncToy that way? This is what I could gather from the bloke that talked to me about the VPN would do but alas I don't know if I would be able to setup a VPN.
[EDIT] Hamachi Well that looks easy enough? Basically I just setup this at both ends to the template folder with names like branch & base set a password and I would have access to the template folder? Then I can use synctoy and sync it? This would also then mean I can access it from anywhere were I have the client setup?[/EDIT]

In essence the templates are the only content of the servers that really needs to be synced but the possibility that it would change daily or within a month is slim making an online sync a bit of a bandwidth waste in retrospect If something on the templates do change one can just email it to the other office with instructions to replace the file immediately that will result in the templates being synced without a major server setup and keeping things simplistic as well, complex setups tent to be way more of a problem when things go wrong.

Then also if I did setup a FTP with the templates you just need to do the FTP update simultaneously when mailing it to the other office. This will mean more of a "manual labour" approach then an automated setup but heck in theory this should do the trick right?

I've never used Hamachi before (though others on this board have recommended it to me previously) so it may well be the answer. I understand where you're going with the template files - and it may work perfectly well - but to my way of thinking, simplicity and reliability should be the rule ...and the way you've described it doesn't seem as simple as it could be.

I have a similar problem with my workplace, and frankly I find the "Have ext. HDD - will travel" aproach the best, though this is a personal preference thing. I find it very comforting to carry the master / backup copy of everything around with me and KNOW that it's secure, rather than risk problems with automated systems (especially if your workmates have a habit of fiddling with things they shouldn't - as mine occasionally do).

If you visit both servers physically on a regular basis (as I do) - and seeing as you allready do daily backups of changed datat files then I recommend you physically synch the backups with your ext. HDD whenever you're there ( followed with a bi-monthly backup of all your data, including the archive stuff). This minimizes automation and gives you complete control. If your on-site visits are infrequent however, then it may be better to synch via Hamachi as you suggested. (At the end of the day 3gig is only a big amount of data when you transfer it electronically. Transporting it *physically* is a piece of cake.)

Need Advice with Synchronizing File servers

Need Advice with Synchronizing File servers

Re: