2 registered members (Robi, C90),
158
guests, and 3
spiders. |
Key:
Admin,
Global Mod,
Mod
|
|
Forums69
Topics113,624
Posts1,341,355
Members1,807
|
Most Online731 Jan 14th, 2020
|
|
|
Secure external storage
#1430887
01/06/2013 11:32
01/06/2013 11:32
|
Joined: Dec 2005
Posts: 16,603 Corridor of Uncertainty
Jim_Clennell
OP
Forum veteran
|
OP
Forum veteran
Joined: Dec 2005
Posts: 16,603
Corridor of Uncertainty
|
MrsC does a lot of photography work, using pretty large RAW files and my stepdaughter is beginning to do the same. We also run a publishing company, which creates a fair amount of data that our authors would prefer us not to lose. We've never really addressed the issue of keeping everything safe in case of a disaster, but 2 recent failures in the power supply to one of our Seagate external disk drives has made me think about setting up some kind of secure storage system. It won't surprise anyone to know that my knowledge of such things is limited, but it seems that some sort of RAID device may be the answer? If I outline the need, I'd be very grateful for any suggestions... We have a mixture of Mac and PC devices both needing access to the files. Currently it's just a case of plugging in the relevant external drive, of which there are about 5, between 500 and 750 GB.
Could we easily make it a networked solution? We have a decent Virgin (netgear) router with a broadband booster plugged in to serve the kids bedrooms. I'm not worried about restricting access to the data/network beyond the usual password system as the files aren't particularly sensitive.
We don't have a lot of cash to throw at it, but it seems to me to be a prime case of better safe than sorry...
Thanks in advance for your ideas!
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1430889
01/06/2013 12:07
01/06/2013 12:07
|
Skins
Unregistered
|
Skins
Unregistered
|
I've used Synology and Netgear ReadyNAS systems and have been very happy with their quality and usefulness.
I currently run a 2-drive readyNAS with two extra, small external drives which I run automatic backups to. One sits on top of the readyNAS and one sits in the car. I just swap them over every week to keep them current and this helps guard against possible fire damage.
They're pretty user-friendly (!).
Last edited by Skins; 01/06/2013 12:15. Reason: comma
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1430922
01/06/2013 18:41
01/06/2013 18:41
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
Jim, RAID devices are not really considered a backup, they just allow you to continue to access your data without interruption. They MAY protect you against a failed hard drive, (Suggestion is to go with hard drives from different vendors). We have a RAID 5 which is quite good, we also have various backup routines, (Apple TimeCapsule, QNAP T219Pii, Buffalo Link Station Live). My advice is the QNAP, but get the TS119 and a separate USB Drive, You can then set the QNAP up to back up Daily to the USB For additional photo backup use the new Flickr service, its very good I make sure we have Apple TIme Machine backing up the Macs, (I have TC, QNAP and Netgear all at same time, it alternates between them), then every day, a separate complete backup is made to the Buffalo via Getbackup Pro this backs up the Boot drive for my Mac Pro. It also syncs my User account with our other Macs, so no matter which Mac I am on, the desktop, docs etc are the same.
Happy
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431080
02/06/2013 18:02
02/06/2013 18:02
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
Seems good value to me. There is one thing to be aware of with NAS drives and that is if the enclosure goes wrong, then you cant just mount the drives in an external case to access the data. So while you may think "Two drives are better than one", remember if the enclosure fails you may be stuffed and that happened to a work friend of mine with a Buffalo and it had to be sent to Holland, they couldn't get the data back and simply sent him a replacement. The support forum may be worth a look. http://forums.buffalotech.com/Personally I would go with a QNAP or Synology single drive and a separate USB drive for better data redundancy. If you really want RAID that can be expanded, these are worth a look http://www.amazon.co.uk/Netgear-Gigabit-Desktop-Network-Storage/dp/B00620CM0I/ref=pd_sim_sbs_ce_1 You can use a single drive, or up to 4 drives. I have both a Buffalo and a Netgear, and rate the Netgear as better. Another good alternative may be a DROBO?
Last edited by charlie_croker; 02/06/2013 18:06.
Happy
|
|
|
Re: Secure external storage
[Re: Hyperlink]
#1431105
02/06/2013 20:01
02/06/2013 20:01
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
If i may suggest another solution you may want to consider a self build system ilike Unriad.
It can be cheaper and far more flexible. No issue with sending kit off if it fails, No issue with limited capacity and upgrade options. No issue with proprietry data formats or transferinf data to new machines.
All you need to start is a usb flash drive, 3 drives (they can be different sizes without an issue) and an old pc and a free copy of the software. http://www.ebay.co.uk/itm/APPLE-POWER-MA...=item35c828ebd8 You can have up to 4 drives, I have a spare copy of OS-X Leopard Server and Might even have a PCI SATA Card for more storage options.
Happy
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431445
04/06/2013 20:06
04/06/2013 20:06
|
Jef_uk
Unregistered
|
Jef_uk
Unregistered
|
Google iosafe
fire proof nas.
There are also secure nas and removable driveswhich are encrypted and cesg approved if you need that type of secure. istorage diskG is an example.
Last edited by Jef_uk; 04/06/2013 20:11.
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431453
04/06/2013 21:31
04/06/2013 21:31
|
GrahamL
Unregistered
|
GrahamL
Unregistered
|
It's probably not a problem with the drive itself, it could just be the small controller board inside the case.
Most of these external cases have to be broken open , but if you do that and then extract the drive you can most likely just plug it into another generic external case or even inside your PC and it'll work fine.
If it is a problem with the drive itself then it may just be the PCB fuses, relatively easy to fix. Other than that you'd be looking at trying to source an identical drive (including firmware revision if possible) and switching the complete PCB.
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431461
04/06/2013 22:17
04/06/2013 22:17
|
Joined: Dec 2005
Posts: 7,704 Harpenden
sugerbear
Je suis un Coupé
|
Je suis un Coupé
Joined: Dec 2005
Posts: 7,704
Harpenden
|
take the drive apart, most enclosures are just held together with screws (sometimes hidden under stickers) Then get hold of one of these. plug in the power to the drive, then the sata or ide cable to the USB port on a laptop and you should be good to go. http://www.amazon.co.uk/Decrescent-Trans...ds=sata+ide+usbThe only point I would make about backing up your data is that you really need two copies of the data in separate locations. If you are worried about your data being held unencrypted in the "cloud" then simply encrypt the data using winzip and use the AES256 password option with a suitably complex password. Use the encrypted copy as an off site backup and the back the rest up to a local drive. (You can use an old PC or you can have a go with something like a raspberry pi and a USB drive).
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431516
05/06/2013 07:52
05/06/2013 07:52
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
It's not the USB - the light on the drive doesn't come on. Thhanks for the tips guys, I think I've got an enclosure that will fit. We don't have any desktops, so I don't think that will work! Almost definitely the enclosure, when a drive fails it normally starts making the click of death. Take your pick of these Enclosures or pop into local PCworld or Maplins. Your drive will be either a 2.5 inch or a 3.5 inch, buy an enclosure that fits that size. The box will be marked as SATA or IDE, chances are the drive is a SATA one if you bought it in last couple of years Takes 5-10 mins at tops to transfer a drive to a new enclosure
Happy
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431553
05/06/2013 13:37
05/06/2013 13:37
|
Joined: Sep 2009
Posts: 5,022 ation
szkom
Club member 2000
|
Club member 2000
Forum is my life
Joined: Sep 2009
Posts: 5,022
ation
|
It's not the USB - the light on the drive doesn't come on. Thhanks for the tips guys, I think I've got an enclosure that will fit. We don't have any desktops, so I don't think that will work! Neither did the light on mine. Pop it in a new enclosure
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431614
05/06/2013 20:19
05/06/2013 20:19
|
Joined: Dec 2005
Posts: 8,417 Lightwater, Surrey
DaveG
Club Treasurer Member 311
|
Club Treasurer Member 311
Je suis un Coupé
Joined: Dec 2005
Posts: 8,417
Lightwater, Surrey
|
I bought a Zxyel NSA325 enclosure plus 2 (identical, oops) x 3 Tb drives and it works well enough for me, although remote access is not as easy as I was expecting, but having said that I've not spent enough time getting my head around all the options.
With all the RAW images you have Jim (5-10Mb each? More?) I would suspect that 2Tb will fill up quickly (remember that RAID 1 means 2 identical drives) and with around 3Tb already on the 5 USB drives, surely you need more? The above NAS box is £80 and 3Tb internal SATA drives are £100 each from ebuyer, so maybe a bit above budget, but better value than 2Tb. 3Tb might ne the upper limit on most NAS boxes, not sure?
1996 Portofino 20vt & 2000 Pearl White Plus 1985½ & 2016 2017 Fiat 124 Spider + XF Sportbrake
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431689
06/06/2013 08:49
06/06/2013 08:49
|
Joined: Dec 2005
Posts: 8,417 Lightwater, Surrey
DaveG
Club Treasurer Member 311
|
Club Treasurer Member 311
Je suis un Coupé
Joined: Dec 2005
Posts: 8,417
Lightwater, Surrey
|
Years ago, before DVD's when CD's were fairly new on PC's and when we first started taking digital pictures, I used to archive to 2xCD's at a time. With over 100 pairs of CD's I've found that they are not too reliable, despite verifying the write and storing one set back on the 'cake' and the other set all in plastic wallets, 2 or 3 of the CD's became unreadable, luckily all different with the other CD being OK, but with CD's holding only 0.75 Gb and DVD's only 4.7 Gb, I'd rather use hard discs or usb drives.
1996 Portofino 20vt & 2000 Pearl White Plus 1985½ & 2016 2017 Fiat 124 Spider + XF Sportbrake
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1431693
06/06/2013 09:30
06/06/2013 09:30
|
Joined: Dec 2005
Posts: 16,603 Corridor of Uncertainty
Jim_Clennell
OP
Forum veteran
|
OP
Forum veteran
Joined: Dec 2005
Posts: 16,603
Corridor of Uncertainty
|
I suppose you can never be 100% sure to cover all possible data loss. I think in total, we have about 1TB of data in need of saving. Although there are a lot of RAW files, many of them MrsC only needs temporarily, as once she has sent them off to her employer, she no longer needs them. The idea is that we will empty a lot of stuff off the HDD on the laptop, (a total of about 100GB including all the data I've ever had!) then she can use that for her work images. The art photos (and the movies she makes and the manuscripts for publishing) which she processes on the MacBook are the ones requiring saving/backing up and there's less than 750GB of those. Although my stepdaughter will probably have around 250GB of data, she stores most of her pictures on the cloud. So, yes, we will be on the way to filling 2TB, but not so quickly that I'll have to worry about buying a third HDD in the next couple of months. With the UnRaid system recommended above by Hyperlink, you can add new drives to the array and it will automatically incorporate them, using the highest capacity drive as the parity drive. If I start with 2x2TB, I'll only have 2TB of storage, but if I then simply add a third drive, I can increase it (if I have understood the way it works!). Unraid software is free for up to 3 drives.
I'm hoping my Father-in-Law may be able to provide me with a donor desktop and - allowing for a few components such as a new PSU/fan and possibly a GB ethernet card, my only other cost will be the 2 drives.
If I manage to recover the data from the Seagate drive and it turns out to be the enclosure that is FUBAR, then I suppose I could even use that drive in my unraid NAS (once wiped and tested). Temporarily at least...
Of course I could keep on improving the spec of any system, or even return to the idea of the Buffalo NAS in Raid 1 that I began this thread with, but I would really like to keep the budget to around £200, with the possibility of growing the capacity later if necessary.
And I like the idea of building something useful out of an old desktop. I mean, what could possibly go wrong...?
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1432522
11/06/2013 08:32
11/06/2013 08:32
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
Its easy to build a PC, I used to always build my own.
Try using a Dual G4 Mac, they are cheap as chips and can accomodate PCI USB2.0 and SATA Cards, have Firewire, and with 4x internal drive bays. You can get these for £50 ish now.
factor in two USB drives and you can do it for peanuts...
Google it and you will find its a common solution.
I have a spare NAS Case, (Raid 1) if you want it, you will need to supply drives though. You can have the case for cost of postage, (Linksys NMH305)
Happy
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1435806
30/06/2013 17:03
30/06/2013 17:03
|
Joined: Dec 2005
Posts: 33,568 Berlin
barnacle
Club Member 18 - ex-Minister without Portfolio
|
Club Member 18 - ex-Minister without Portfolio
Forum Demigod
Joined: Dec 2005
Posts: 33,568
Berlin
|
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1436018
01/07/2013 18:11
01/07/2013 18:11
|
Joined: Dec 2005
Posts: 16,603 Corridor of Uncertainty
Jim_Clennell
OP
Forum veteran
|
OP
Forum veteran
Joined: Dec 2005
Posts: 16,603
Corridor of Uncertainty
|
Thanks Mark.
As I thought, SMB was already enabled, set to Export read/write; I can't see AFP mentioned anywhere, there's just SMB and NFS. Do I need to install something else on UNRAID. I must say, my GUI is a bit crap compared with yours... Maybe it's because I've gone with the stable 4.7 version, not a fancy Dan 5.x?
For the shares, I've just given each family member a share name plus one that I imagined would be the hierarchical parent share, but could just as easily be the 'shared share'.
As yet I haven't assigned the parity drive, as it will add significantly to the time it takes to populate the array with data. I can cope with the security risk...
I'll try to assign the drive by mapping the network, but as my man-flu kicks in, I may fail dismally...
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1436024
01/07/2013 18:23
01/07/2013 18:23
|
Joined: Jun 2006
Posts: 5,244 Watford, Herts.
Hyperlink
Forum is my life
|
Forum is my life
Joined: Jun 2006
Posts: 5,244
Watford, Herts.
|
Excuses, excuses There is no risk with your plan so long as you copy rather than move as you still have the original copy on the source drive. If each user has their own shame thats probably a good option as you can limit size taken, permissions and which drives are used more easily than the other option. If you using 4.7 that will explain no AFP as it was added later. Also your workgroup is probably "mshome" rather than "WORKGROUP" which will explain the other issue.
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1438053
15/07/2013 19:14
15/07/2013 19:14
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
Well, it's all up and running; In your face, those who scoff at my technical skillz!
The Mac can access the data via SMB (thanks Charlie).
It took a while to upload all the data, assign the parity drive and then to perform the parity check, but it's now sorted.
All I need to do now is set up some kind of VPN/web access so I can play my music from my ipad when I'm not at home! (Also, less frivolously, MrsC wants access to her pics) Should be easy to do, Sort out a DDNS, setup a VPN in router and then let port forwarding do the rest. (Hint use a static IP for the Storage system/RAID)
Happy
|
|
|
Re: Secure external storage
[Re: charlie_croker]
#1438175
16/07/2013 17:37
16/07/2013 17:37
|
Joined: Dec 2005
Posts: 16,603 Corridor of Uncertainty
Jim_Clennell
OP
Forum veteran
|
OP
Forum veteran
Joined: Dec 2005
Posts: 16,603
Corridor of Uncertainty
|
Well, it's all up and running; In your face, those who scoff at my technical skillz!
The Mac can access the data via SMB (thanks Charlie).
It took a while to upload all the data, assign the parity drive and then to perform the parity check, but it's now sorted.
All I need to do now is set up some kind of VPN/web access so I can play my music from my ipad when I'm not at home! (Also, less frivolously, MrsC wants access to her pics) Should be easy to do, Sort out a DDNS, setup a VPN in router and then let port forwarding do the rest. (Hint use a static IP for the Storage system/RAID) Yes, well, I asked for that... How does one "sort out a DDNS"? Is it like jumble sale? I have read that the Virgin superhub router I have can be bolshy when it comes to VPNs. How can I tell and, er, persuade it to cooperate? If I have a fixed IP address, why do I need a DDNS? As another FCCUK person might say: other foolish questions are available...
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1438189
16/07/2013 19:35
16/07/2013 19:35
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
Jim, http://www.noip.com/services/managed_dns/free_dynamic_dns.html explains DDNS, Basically you get a web address that always links back to your home network. You are very unlikely to get a fixed Public (internet) IP, your ISP will allocate a DNS from it's pool of addresses, which means that one day you may be 84.23.22.12 and a week later you will be 84.23.22.255 The easiest way to think of this is that imagine you are trying to ring your home telephone but the number keeps changing, an almost impossible task. A DDNS will for example allow you to have Jim.noip.us and no matter what IP address your ISP allocates, typing Jim.noip.us will take you to your network, (or more correctly to your router). To accomplish this feat, the DDNS requires you to either run an app on your PC, or a modern router will let you enter the DDNS details and update automatically. Virgin Superhub is a pile of poo, spend a few quid on an ASUS RT56 or even better RT66 and stick your Superhub in "modem only mode", thats what I have done. The Asus routers make setting up a VPN a breeze, port forwarding etc a breeze and get supported with lots of firmware upgrades. The Fixed IP address is on your internal network, for example your router will be 192.168.1.1 then other devices will be allocated internal ip addresses dynamically (like your ISP does), same problem, you want to be able to enter Jim.noip.us and be taken to your storage So setup the router to allocate certain "Mac addresses" to a specific internal ip address. (each network device has a mac address). So for example my RT66 allocates my QNAP to always be 192.168.1.46, lets assume you will do the same Now we need to set up the port forwarding on router. Select a port at random, for example,, 12123 now set up port forwarding to forward any requests for that port to 192.168.1.46 So now when you type Jim.noip.us:12123 you will be connected to your storage device. I hope that makes sense? Mick
Last edited by charlie_croker; 16/07/2013 19:37.
Happy
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1438226
16/07/2013 22:30
16/07/2013 22:30
|
Joined: Jul 2009
Posts: 2,617 SE Essex
charlie_croker
I need some sleep
|
I need some sleep
Joined: Jul 2009
Posts: 2,617
SE Essex
|
Make sure you have the R38 firmware on the Superhub. Personally I found it nothing but trouble. As is so often the case, ISPs go for the cheapest rather than the best Routers. The ASUS routers are faster, have hardware NAT, better wireless range, faster WAN to LAN performance, and these are common features you would want. The AI disk, the USB ports etc may not be 100% needed. Here's an indication of my internet speed This review of an early version of the RT56 makes for interesting reading RT56 Review Some info regarding port forwarding on the Superhub http://community.virginmedia.com/t5/Up-t...ed/td-p/1289387
Last edited by charlie_croker; 16/07/2013 22:37.
Happy
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1438287
17/07/2013 10:37
17/07/2013 10:37
|
Joined: Dec 2005
Posts: 16,603 Corridor of Uncertainty
Jim_Clennell
OP
Forum veteran
|
OP
Forum veteran
Joined: Dec 2005
Posts: 16,603
Corridor of Uncertainty
|
Thanks for the offer, charlie, but I've already overspent on this, so if I can use what I've got then I will.
Basically, I just want to be able to access files (music, photos and Office primarily) when I'm out and about - over wifi and 3G.
I don't have massive worries over security, as there's nothing sensitive on the disks, but obviously password protection would be essential.
I don't know what my options are, really. I understand just about what a VPN is, but if I don't need it and can just type in a URL and get what I want then all the better...
|
|
|
Re: Secure external storage
[Re: barnacle]
#1438293
17/07/2013 11:27
17/07/2013 11:27
|
TimR
Unregistered
|
TimR
Unregistered
|
If it's for playing music surely the security issue would be someone else seeing what (maybe) poor taste you have?
|
|
|
Re: Secure external storage
[Re: ]
#1438301
17/07/2013 12:04
17/07/2013 12:04
|
Joined: Dec 2005
Posts: 16,603 Corridor of Uncertainty
Jim_Clennell
OP
Forum veteran
|
OP
Forum veteran
Joined: Dec 2005
Posts: 16,603
Corridor of Uncertainty
|
If it's for playing music surely the security issue would be someone else seeing what (maybe) poor taste you have? Hey, I wear my poor musical taste with pride. Often on T shirts. I take your point, Neil.
|
|
|
Re: Secure external storage
[Re: Jim_Clennell]
#1439545
26/07/2013 08:30
26/07/2013 08:30
|
Joined: Dec 2005
Posts: 16,603 Corridor of Uncertainty
Jim_Clennell
OP
Forum veteran
|
OP
Forum veteran
Joined: Dec 2005
Posts: 16,603
Corridor of Uncertainty
|
I seem to have set myself up for a fall...
On Tuesday morning, I switched off and unplugged the server (as well as all other cables for router, TV, etc) when it looked likely that storms were a-coming. By the evening, everything had calmed down, so I plugged it all back in and got everything going again. Then, twice we had complete power black-outs for a second or so at a time and since then, it's been a nightmare.
I couldn't reach the "tower" (the name the unraid server calls itself) through the GUI on the laptop, so I couldn't power it down. Eventually, I just had to manually turn it off (I didn't have the console screen attached to work on the box directly).
Having forced a shutdown, I restarted it and had the same problem: I'd enter "//tower" intro firefox address bar and just be given google search results including Tower Records. Hugely frustrating.
Finally, I powered it down manually again, then took out the USB stick. I re-flashed this with the last working config I had saved on my laptop and put it back in and switched on.
Thankfully I reached the Tower and performed a clean shutdown.
I then left it switched off and unplugged until an electrician had been and checked our electrics yesterday (our lighting ring main had also gone on the fritz). So yesterday evening, I plugged everything back in and powered up... Still can't reach "//tower" or "tower:8080".
I reconnected the screen to the server and I can log on to the tower using the password, but without the GUI, I can't restart the array or perform a parity check or ensure the data is all safe.
I can't believe that losing power for a second twice can completely render this fubar.
Any ideas...?
|
|
|
|