Advice on Network attached Storage??

120 posts / 0 new
Last post
sb56637
sb56637's picture
Offline
Last seen: 2 hours 36 min ago
Joined: 01/08/2010 - 09:29
Posts: 6994
Location: The Light

Whew! All’s well that ends well I guess.

Well, I’m not not a fan of Windows, so that’s probably coloring my response, but I would still suspect a “minor” Windows glitch of not showing the actual folder contents to be what’s really at fault. Of course, there’s nothing “minor” about being presented with an Explorer window that seems to indicate that you’ve lost your entire digital life…

Quote:
I guess what I will have to do go through all the folders individually and “refill” the empty ones. After I have that done (probly 2-3 hours more work left to do), I will try running a backup from the first NAS drive to the second one that is installed in it using the NAS software and see if it has the same shortcoming.

This shouldn’t be necessary. There’s an industry-standard tool called Rsync that is specifically designed to handle this sort of situation where a large transfer of many files in different folders could be interrupted. It should automatically check to see which files and folders have already been completely transferred during the last run, and then it will “fill in the blanks” until the exact same folder structure and contents that you have on your local disk are replicated on your NAS. The only caveat is that you’d have to make sure that the other backup software that you’re using is actually creating a transparent folder structure directly on the NAS filesystem, not throwing everything into an opaque database that only the backup software can understand. And I personally would not trust that backup software. It’s really best to stick with open source industry standard methods for backups, since that is such a fundamental concept of computing that hardcore geeks have already solved and perfected a long time ago. There’s really no need for proprietary solutions that just reinvent the wheel and often result in flat tires too.

Budget Light Forum ...where Frugal meets with Flashlight!

Photon Master
Offline
Last seen: 2 hours 32 min ago
Joined: 04/07/2018 - 14:04
Posts: 606
Location: Mars

So you didn’t lose your files? That’s great news!

f0xx
f0xx's picture
Offline
Last seen: 5 days 7 hours ago
Joined: 02/27/2019 - 18:44
Posts: 453
Location: Near Dallas, Texas

Rsync is good stuff. I’ve used a Windows friendly version long ago called “DeltaCopy” that might be the easiest way to get started. You’d use the client version on your computer and it would connect to the NAS (if rsync is enabled on the NAS).

Photon Master
Offline
Last seen: 2 hours 32 min ago
Joined: 04/07/2018 - 14:04
Posts: 606
Location: Mars

I love rSync. I use it to copy files between a remote Linux server and my OneDrive to eliminate the need to consume bandwidth by pulling the stuff down to my own PC first

vestureofblood
vestureofblood's picture
Offline
Last seen: 11 hours 16 min ago
Joined: 08/17/2012 - 15:21
Posts: 1977
Location: Missouri

I’m working on the Rsync thing, or more like I got a guy coming to do it Grad I watched one video about it and decided to call for backup instead.
.
.
Meanwhile I have something else I need to get your opinions on. I’ve got a major security issue with my email setup I need to solve.
Currently I use one main email (gmail account) and the customer support link from my shop goes to that, all outgoing tracking numbers etc. The mail client provided by my web host is the saddest most inadequate thing I have ever seen. To resolve this the gmail address had to be “ported” into the website somehow ( I pay a guy to work on that too). The major down side is that my email address and password has to be stored in the webhost data base for this to work. The guy that works on it for me did encrypt the password so that it cant be seen even from back office of the shop etc, but the fact remains it is inside the database.
.
.
I have recently purchased another domain that I will be switching to (Lumencraft), but its at the same host, on the same platform etc. I signed up for some Gmail thing that will allow me to have a business email name like “customerservice @ lumencraft” which I would like to switch everything to, but at the same time eliminate the email password from being stored in the database. So far the only idea I’ve had is running two separate emails, one for only direct customer responses and one for everything else. Not a great solution, but I could live with it if I had to. Is there some other way I could solve this problem and still have all my email in one place?

In Him (Jesus Christ) was life; and the life was the light of men. And the light shineth in darkness; and the darkness comprehended it not.
http://asflashlights.com/ Everyday Carry Flashlights, plus Upgrades for Maglite.

sb56637
sb56637's picture
Offline
Last seen: 2 hours 36 min ago
Joined: 01/08/2010 - 09:29
Posts: 6994
Location: The Light

Hi there, so I understand that you signed up for Gmail for business with your lumencraft domain? In that case it seems like it would just be a matter of using that directly, assuming you like the Gmail interface. Of course you would also have to configure your website to use that email address for things like contact forms, etc. Generally you would configure your website to send out automated confirmations from a non-monitored email address like noreply @ lumencraft. Or you can also probably create multiple addresses with your Gmail business email. You could also configure a catch-all email address that will receive all messages sent to anything at lumencraft. And you can definitely integrate all your emails into one place in Gmail. Or if you don’t like the web interface then you can connect any number of email addresses to an email client software on your computer like Thunderbird or Outlook. Or is there something else I’m not understanding?

Budget Light Forum ...where Frugal meets with Flashlight!

how crazy is this
Offline
Last seen: 40 min 37 sec ago
Joined: 09/14/2011 - 13:24
Posts: 343
Location: Minneapolis

If I understand sb5637’s response correctly I would re-state it in terms that may be easier to understand. Your web host needs an email account to send out notices. You can set up a discrete email account for this purpose. That account would have a unique password and would not give access to your other email accounts. There are many email client programs, including Gmail and Thunderbird, where you can setup multiple email accounts with discrete passwords for each, that will allow you to have all your mail in one place.

Hope this helps.

I don’t want to hijack the thread but would like to ask this question and am not sure of the proper etiquette. For nearly 24 years I have had multiple DNS entries pointing to my network. I believed in the internet and that it should be a great equalizer and that we should all have equal opportunity to have a presence on it. I have had my little piece of the internet for nearly a quarter of a century now. As far as I can determine it appears that pretty much no one else sees things this way. Does anyone else here maintain their own publicly routable IP network?

manithree
Offline
Last seen: 2 hours 2 min ago
Joined: 01/12/2013 - 01:08
Posts: 530
Location: Orem, UT, USA
how crazy is this wrote:
I don’t want to hijack the thread but would like to ask this question and am not sure of the proper etiquette. For nearly 24 years I have had multiple DNS entries pointing to my network. I believed in the internet and that it should be a great equalizer and that we should all have equal opportunity to have a presence on it. I have had my little piece of the internet for nearly a quarter of a century now. As far as I can determine it appears that pretty much no one else sees things this way. Does anyone else here maintain their own publicly routable IP network?

I have dynamic DNS entries pointing to my home network. Not for public consumption, just for my own use when I’m not at home. I have a jitsi-meet instance in AWS that I fire up for virtual family get-togethers, and I would like to run a matrix server, and maybe join the fediverse somehow. But I haven’t gotten ‘round to it.

But I don’t run BGP (ISPs that let you do that are expensive) is that what you’re asking?

how crazy is this
Offline
Last seen: 40 min 37 sec ago
Joined: 09/14/2011 - 13:24
Posts: 343
Location: Minneapolis

manithree wrote:

I have dynamic DNS entries pointing to my home network. Not for public consumption, just for my own use when I’m not at home. I have a jitsi-meet instance in AWS that I fire up for virtual family get-togethers, and I would like to run a matrix server, and maybe join the fediverse somehow. But I haven’t gotten ‘round to i.

But I don’t run BGP (ISPs that let you do that are expensive) is that what you’re asking?

Well I do pay relatively a lot for my internet access. My network is a ipv4 .248 subnet business class service. Had to lookup BGP. If I understand it, each of my ISP’s have been doing that and I just use my .248. In the process of switching to a new ISP and they are taking a much different approach. Haven’t wrapped my head around it yet. However, until this point, my gateway IP is part of the .248 subnet. Have been told that I am connected in bridge mode but not certain if that is correct. The gateway IP address has always been handled by my ISP. The 5 useable addresses are what I work with. My new IP wants me to have an entirely different gateway address from them. Then I am expected to create the entire .248 subnet within my network including the gateway address that historically has been at my ISP. Assuming I go through with the change I will be doing something that I think is quite different from what I have been doing all these years.

how crazy is this
Offline
Last seen: 40 min 37 sec ago
Joined: 09/14/2011 - 13:24
Posts: 343
Location: Minneapolis

I guess what I am getting at is am I just a crazy old fool? Are there others out here doing the same thing? The way I look at it, as a business, I am paying to be on the internet. If I want to share something on the internet I should be able to and have been doing so for a very long time. If I want to share a picture I share a picture Smile

This has suddenly stopped working. For years when I wanted to post a picture on this forum I just did so. I see now that I can no longer do that and that my prior pictures no longer appear.

sb56637
sb56637's picture
Offline
Last seen: 2 hours 36 min ago
Joined: 01/08/2010 - 09:29
Posts: 6994
Location: The Light
how crazy is this wrote:
This has suddenly stopped working. For years when I wanted to post a picture on this forum I just did so. I see now that I can no longer do that and that my prior pictures no longer appear.

Hmm, I see the picture in your last post. The TH20 clipped onto the tie?

Budget Light Forum ...where Frugal meets with Flashlight!

how crazy is this
Offline
Last seen: 40 min 37 sec ago
Joined: 09/14/2011 - 13:24
Posts: 343
Location: Minneapolis

sb56637 wrote:

Hmm, I see the picture in your last post. The TH20 clipped onto the tie?

Hmm, I see that in my web server log. Wonder why you see it and I don’t here? Typing this on my mint box and I don’t see it on the forum on that platform as well. In a separate tab I have the same URL and it displays just fine.

Probably due to HTTP Need to go to HTTPS but it hasn’t been much of a priority as it is all static and most modals not loaded. Need to look at moving to a distro that can replace the Mac Possibly run on some kind of VM?

sb56637
sb56637's picture
Offline
Last seen: 2 hours 36 min ago
Joined: 01/08/2010 - 09:29
Posts: 6994
Location: The Light

@how crazy is this: Ah, you know what, you’re right. I normally use the latest Firefox on Linux, which doesn’t seem to have any trouble with mixed-mode content. But I tried it on Chromium 89.0.4389.72 for Linux and it failed to show your image, yet it does show the “secure” padlock with no mixed content warnings, so I assume that Chromium is just ignoring the HTTP links. Whereas this is what Chrome on Windows 7 shows, according to Browserling:
https://i.imgur.com/B6TGe8s.png
Looks like “this is a feature, not a bug”, according to this:
https://blog.chromium.org/2019/10/no-more-mixed-messages-about-https.html
I’m personally not in agreement with everything that Google is doing to try to force everyone’s hand and insist on HTTPS everywhere. At most they could just discreetly change the icon to indicate there is mixed content, and leave it at that. They go to such effort to protect unaware or incautious users from themselves, and then they show those same vulnerable users a nice pretty green padlock on the phishing lookalike banking websites that the scammers correctly configure with full SSL support across the site.

Budget Light Forum ...where Frugal meets with Flashlight!

f0xx
f0xx's picture
Offline
Last seen: 5 days 7 hours ago
Joined: 02/27/2019 - 18:44
Posts: 453
Location: Near Dallas, Texas

how crazy is this wrote:
I guess what I am getting at is am I just a crazy old fool? Are there others out here doing the same thing? The way I look at it, as a business, I am paying to be on the internet. If I want to share something on the internet I should be able to and have been doing so for a very long time. If I want to share a picture I share a picture Smile

This has suddenly stopped working. For years when I wanted to post a picture on this forum I just did so. I see now that I can no longer do that and that my prior pictures no longer appear.

I can understand the sentiment, and I think from the angle of “a right to do so” you’re in the clear. But from a security standpoint, I wouldn’t expose anything to the internet that I didn’t have to in order to function. While you can secure your environment enough that it is less likely to be compromised, there will eventually be someone that can break in. It is much less likely to happen if you have a minimal attack surface.

The only incoming port I have open is for my VPN. If I want to access anything at my home or office it is over VPN (encrypted with long keys).

I don’t host my own images for stuff like this forum since the free hosting options out there (imgur is what I use) are pretty decent, and I don’t have to spend anything for the infrastructure to do it. I don’t have any static IPs at the house.. I use a dynamic DNS service called “Duck DNS to keep track of my IP and the aforementioned VPN for access.

For your business, do you have anything on your server(s) worth protecting? (either for privacy or for financial reasons)

If you do, you may want to weigh the cost of getting a small VPS (Azure, AWS, Google Cloud, Vultr, Digital Ocean, Linode, etc) to host your content (some of the smaller VPS’s will run a website really well) vs what you are paying now to do it all on your hardware. You’d maintain control of it, but you might save some money.. and you’d move the target away from your business directly.

how crazy is this
Offline
Last seen: 40 min 37 sec ago
Joined: 09/14/2011 - 13:24
Posts: 343
Location: Minneapolis
sb56637 wrote:
@how crazy is this: Ah, you know what, you’re right. I normally use the latest Firefox on Linux, which doesn’t seem to have any trouble with mixed-mode content. But I tried it on Chromium 89.0.4389.72 for Linux and it failed to show your image, yet it does show the “secure” padlock with no mixed content warnings, so I assume that Chromium is just ignoring the HTTP links. Whereas this is what Chrome on Windows 7 shows, according to Browserling: https://i.imgur.com/B6TGe8s.png Looks like “this is a feature, not a bug”, according to this: https://blog.chromium.org/2019/10/no-more-mixed-messages-about-https.html I’m personally not in agreement with everything that Google is doing to try to force everyone’s hand and insist on HTTPS everywhere. At most they could just discreetly change the icon to indicate there is mixed content, and leave it at that. They go to such effort to protect unaware or incautious users from themselves, and then they show those same vulnerable users a nice pretty green padlock on the phishing lookalike banking websites that the scammers correctly configure with full SSL support across the site.

That’s it! Using Brave on both Mac and Mint. (Latest FF crashes on my mint.) Did go back to the ESR and sure enough the image shows in FF.

Have not been worried about a man in the middle attack. Would not occur to me that an ISP would even consider doing that. Turns out that I may have been part of such thing. Doubt they went so far as to do this with my .248 but who knows what they are doing with the WiFi they are running out of the same box. They run that and it is an entirely different network. Read that they were inserting adds in browsers that people who connect to it were using.

vestureofblood
vestureofblood's picture
Offline
Last seen: 11 hours 16 min ago
Joined: 08/17/2012 - 15:21
Posts: 1977
Location: Missouri

Making a little progress. By doing the copy/paste transfers in side by side windows I was able to get drives 2 and 3 loaded with my data. One thing that I was hoping would be an option with this is for me to take one of those drives and plug it into a PC with a sata cable ( like if the NAS was damaged etc) and get acess to the data that way. However when I plug this in where the old HDD the PC doesn’t recognize it. Is it possible to get it to do that?

In Him (Jesus Christ) was life; and the life was the light of men. And the light shineth in darkness; and the darkness comprehended it not.
http://asflashlights.com/ Everyday Carry Flashlights, plus Upgrades for Maglite.

manithree
Offline
Last seen: 2 hours 2 min ago
Joined: 01/12/2013 - 01:08
Posts: 530
Location: Orem, UT, USA

vestureofblood wrote:
Making a little progress. By doing the copy/paste transfers in side by side windows I was able to get drives 2 and 3 loaded with my data. One thing that I was hoping would be an option with this is for me to take one of those drives and plug it into a PC with a sata cable ( like if the NAS was damaged etc) and get acess to the data that way. However when I plug this in where the old HDD the PC doesn’t recognize it. Is it possible to get it to do that?

From windows, probably not. Your NAS likely runs a bsd unix and stores data on the drive in a unix filesystem that windows doesn’t know about.
ETA: synology is linux based, and your data is either in ext4 or btrfs. There are drivers for ext4, but last I checked writes were very slow. And btrfs is more likely, and that’s best left to linux.
prototype3a
Offline
Last seen: 5 hours 24 min ago
Joined: 12/19/2018 - 20:06
Posts: 315
Location: Christiansburg, VA

Only high end Synology units support BTRFS. Generally only models with a + in the model as BTRFS requires more cpu horsepower than SHR/EXT4.

But yes, one nice thing about Synology is that if you want to replace the unit or upgrade or whatever, you can generally just pull the drives, shove them into a new chassis and be back up and running in no time.

At some point, I’ll probably upgrade to a 12bay unit with BTRFS and 10gb ethernet…

manithree
Offline
Last seen: 2 hours 2 min ago
Joined: 01/12/2013 - 01:08
Posts: 530
Location: Orem, UT, USA

That’s another thing I forgot to mention. If there’s any RAID, LVM, or BTRFS pools, windows access is a big fat “nope.” I’ve never had synology, so I don’t know what their default configuration is, or how much flexibility you have in configuring the low-level disk layouts.

vestureofblood
vestureofblood's picture
Offline
Last seen: 11 hours 16 min ago
Joined: 08/17/2012 - 15:21
Posts: 1977
Location: Missouri

This has really been the most needlessly complicated, expensive, time consuming setup I’ve done in a log time. Basically the only real advantage to this system is that you can pool data and access it from multi PCs. That said, its the function I needed more than anything! To overcome the drive compatibility issue of the NAS I made a backup to an 8TB USB drive that I will just update twice a year when do the SSDs with my programs on them. That way if the NAS dies I still have instant access to the data.
.
.
.
I appreciate you guys so much. I cant say enough about the level of expertise, and willingness to help others that you all continuously show. Thank you.

In Him (Jesus Christ) was life; and the life was the light of men. And the light shineth in darkness; and the darkness comprehended it not.
http://asflashlights.com/ Everyday Carry Flashlights, plus Upgrades for Maglite.

zoulas
zoulas's picture
Online
Last seen: 11 min 47 sec ago
Joined: 06/01/2020 - 08:35
Posts: 819

Windows tends to be forgiving meaning it won’t delete what it does not copy. The files are likely there somewhere.

vestureofblood
vestureofblood's picture
Offline
Last seen: 11 hours 16 min ago
Joined: 08/17/2012 - 15:21
Posts: 1977
Location: Missouri

I have just about got this all set, but I am wondering, do you guys know how (or if its even possible) to make the second drive in the NAS to incremental copies of the data? Basically when I make an update to an XLS spreadsheet in drive A, the information gets copied to B. But not by making a whole new copy of the entire drive and then deleting the old copy.

In Him (Jesus Christ) was life; and the life was the light of men. And the light shineth in darkness; and the darkness comprehended it not.
http://asflashlights.com/ Everyday Carry Flashlights, plus Upgrades for Maglite.

prototype3a
Offline
Last seen: 5 hours 24 min ago
Joined: 12/19/2018 - 20:06
Posts: 315
Location: Christiansburg, VA

I believe this is called a “snapshot” and as far as I know it is possible but I haven’t personally messed with it.

f0xx
f0xx's picture
Offline
Last seen: 5 days 7 hours ago
Joined: 02/27/2019 - 18:44
Posts: 453
Location: Near Dallas, Texas

I think that in a 2 bay NAS the drives are typically mirrored (1:1 copy). This means that your storage is only 1/2 the total capacity of 2 drives, but the upside is that if you loose one you shouldn’t loose any data. “RAID is not a backup” is the mantra we repeat in IT.

There may be some NAS manufacturers that provide that option in their software, but I am not aware of any that do. Incremental backups are great for saving space, but you have to have the full backup file + any incrementals to restore the file if something went bad, so that would defeat the benefit of your redundant disk.

If you are wanting file versioning/history for your files so you can go back to a specific version (maybe you make a bad edit and then need the old file?) that is a feature built into windows.

How to set up file history in Windows

Hank33
Hank33's picture
Offline
Last seen: 41 min 32 sec ago
Joined: 11/22/2019 - 16:00
Posts: 770
Location: Vancouver, B.C.

My NAS is setup for Raid 1(mirroring). Not really incremental but I just want as little interaction as possible with the NAS so I just leave it as a mirror setup.

 

                                                                                             

vestureofblood
vestureofblood's picture
Offline
Last seen: 11 hours 16 min ago
Joined: 08/17/2012 - 15:21
Posts: 1977
Location: Missouri

I am also wondering if its normal for it to constantly be making noise. It sounds like a little coffee pot under the bench, which I would expect if any files were being accessed, but it basically never shuts up. It seems like when I first got it that it would shut up after a while, so I am wondering if I did something to it. It does have a task manager but I cant get it to give me an “end task” option.

In Him (Jesus Christ) was life; and the life was the light of men. And the light shineth in darkness; and the darkness comprehended it not.
http://asflashlights.com/ Everyday Carry Flashlights, plus Upgrades for Maglite.

netprince
Offline
Last seen: 1 hour 2 min ago
Joined: 06/14/2012 - 13:48
Posts: 609
Location: Virginia

The noise is normal, some hard drives make (a lot) more noise than others, so you may or may not hear the idle noises. But yes noisy drives will sound like you describe.

It also sounds like you want to schedule regular snapshots if you want to keep old versions of files for a while. This is a very good idea to help protect against ransomware. I try to schedule snapshots for 2-3 times a week, and keep at least a months worth. This is because if you get ransomware you may not know it for a week or two, it slowly encrypts your files in the background.

Lightbringer
Lightbringer's picture
Online
Last seen: 2 min 31 sec ago
Joined: 08/30/2016 - 14:12
Posts: 14041
Location: nyc

It may be some “housekeeping” of some sort in the background (indexing, defragging, who knows).

When I’d offload dozens of gigamegs of data onto a NAS, it’d go from pretty uneventful and quiescent before, to the flurry of activity when it’s actually doing the copying, and then even when it’s over it’d keep bonking away in the background.

If even let it set a day or more, so I could turn it off when it was all done with everything, but it’d just keep going. Unmount, turn off., etc., then back on, and everything’s okay, nothing wrong. It could take a long while for it to “catch up” and be done.

09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0

anonymous_user
Offline
Last seen: 2 days 4 hours ago
Joined: 05/23/2019 - 21:59
Posts: 312
Location: CA, USA

vestureofblood wrote:
I am also wondering if its normal for it to constantly be making noise. It sounds like a little coffee pot under the bench, which I would expect if any files were being accessed, but it basically never shuts up. It seems like when I first got it that it would shut up after a while, so I am wondering if I did something to it. It does have a task manager but I cant get it to give me an “end task” option.
!https://i.postimg.cc/26ggdb4T/Inked-Nas-is-loud-LI.jpg!

I don’t know if you noticed it but that “System Partition Failed” message might be worth investigating. You should go into the Storage Manager and see if the error is for one of your hard disks.

Pages