deionmann

Members
  • Posts

    106
  • Joined

  • Last visited

Converted

  • Gender
    Undisclosed

Recent Profile Visitors

The recent visitors block is disabled and is not being shown to other users.

deionmann's Achievements

Apprentice

Apprentice (3/14)

1

Reputation

  1. I'm pretty sure all you have to do is setup the notifications settings in the gui to send emails and you'll get it via email from that notification script Sent from my SM-N920V using Tapatalk
  2. Ummm I'm not sure, I'll see if I can find the info Sent from my SM-N920V using Tapatalk
  3. [emoji41] Sent from my SM-N920V using Tapatalk
  4. Here's how I've appended it rsync -avh --log-file=/mnt/user/godzilla/pictures/pictures-backup.log --stats /mnt/disks/godzilla_pictures/ /mnt/user/godzilla/pictures then my notifications call looks like this /usr/local/emhttp/webGui/scripts/notify -s "`hostname` Rsync Backup complete" -i "normal" -d "Backup of Pictures share complete `date` `tail /mnt/user/godzilla/pictures/pictures-backup.log`"
  5. I was playing around last night and was able to get something similar to the robocopy printout 2016/04/06 23:44:53 [14503] Number of files: 17 (reg: 13, dir: 4) 2016/04/06 23:44:53 [14503] Number of created files: 0 2016/04/06 23:44:53 [14503] Number of deleted files: 0 2016/04/06 23:44:53 [14503] Number of regular files transferred: 0 2016/04/06 23:44:53 [14503] Total file size: 966.53M bytes 2016/04/06 23:44:53 [14503] Total transferred file size: 0 bytes 2016/04/06 23:44:53 [14503] Literal data: 0 bytes 2016/04/06 23:44:53 [14503] Matched data: 0 bytes 2016/04/06 23:44:53 [14503] File list size: 0 2016/04/06 23:44:53 [14503] File list generation time: 0.001 seconds 2016/04/06 23:44:53 [14503] File list transfer time: 0.000 seconds 2016/04/06 23:44:53 [14503] Total bytes sent: 390 2016/04/06 23:44:53 [14503] Total bytes received: 15 2016/04/06 23:44:53 [14503] sent 390 bytes received 15 bytes 810.00 bytes/sec 2016/04/06 23:44:53 [14503] total size is 966.53M speedup is 2,386,492.95 adding the --stat and --log-file=[location of logfile] triggers will create that printout in an external log file of your choosing then on your message body use `tail [location of your logfile]`
  6. Thanks allot @gundamguy Think I finally got my script down #!/bin/bash ##Perform backup of Documents share from Godzilla > Mothra and notify /usr/local/emhttp/webGui/scripts/notify -s "`hostname` Rsync Backup Started" -i "normal" -d "Backup of Documents share started `date`" rsync -avh --log-file=/mnt/user/godzilla/documents/documents-backup.log /mnt/disks/godzilla_documents/ /mnt/user/godzilla/documents /usr/local/emhttp/webGui/scripts/notify -s "`hostname` Rsync Backup complete" -i "normal" -d "Backup of Documents share complete `date` `rsync -avh --log-file=/mnt/user/godzilla/documents/documents-backup.log /mnt/disks/godzilla_documents/ /mnt/user/godzilla/documents`" ends up giving me this via pushover
  7. I honestly haven't had any issue with my M1015 cards getting hot. But then again my cases have at least 6 fans blowing from front to back and sit in my storage room that never gets much warmer than 60°F Your PCIE 1v2 throughput comparison sounds accurate, made my bug to upgrade that mobo go into overdrive [emoji16] Remember though, it's always about the weakest link, with the hp card nothing will ever go faster than 3GBs... Which is totally fine when running non ssd drives.
  8. Thanks guys, I think I got it working pretty good. I ended up with a cron that points to a .sh file Cron: #Perform daily backup of Pictures share from Godzilla > Mothra at 12:30am 30 00 * * * /boot/config/plugins/dynamix/godzilla_pictures.sh |& logger .sh: #!/bin/bash ##Perform backup of Pictures share from Godzilla > Mothra and notify /usr/local/emhttp/webGui/scripts/notify -e "Rsync Backup" -i "normal" -s "Rsync backup of Godzilla share: Pictures started at `date`" rsync -a --progress /mnt/disks/godzilla_pictures/ /mnt/user/godzilla/pictures |& logger /usr/local/emhttp/webGui/scripts/notify -e "Rsync Backup" -i "normal" -s "Rsync backup of Godzilla share: Pictures complete at `date`" Now let me ask you guys this. Is there anyway that I can have rsync log a synopsis of what it did? Like for example "synced 544 files in 30 minutes with an average of 102MBs" Then loop that info into the notification when rsync finishes? I know, I know, it's overkill.... But it would be cool [emoji41]
  9. Super interesting information over at ServeTheHome. So you have a speed of 95 - 105MB/s during rebuilding. Not sure what the speed is when you connect all drives to HBA's. Anyone? And is there difference when you connect more drives. What is the theoretical speed per drive in a 24 bay case when you connect 2 channels. Now my understanding of the concept could be wrong here... But the HP SAS expander is capable of 3Gbs per channel, in dual link mode 8 channels worth of thourouput will be available to you, eg 24Gbs... Given 24 drives spinning you should THEORETICALLY get around 1Gbs or 125MBs MAX per channel/drive I suspect that im getting less than 125MBs because I'm using an atx 775 board with PCIx8v1 instead of v2 like the M1015 wants
  10. The short answer is there is no way to do this in unRAID. There are Dockers which you CAN use to do this for you such as Crashplan: https://lime-technology.com/forum/index.php?topic=33864.0 There have been efforts by unRAIDers to develop scripts to use Rsync to do what you are asking. See here: http://lime-technology.com/forum/index.php?topic=24581.0 Also, there is an experimental Docker for an application that was written to be a front-end to Rsync (more on this below). See here: http://lime-technology.com/forum/index.php?topic=39646.0 However (assuming that both servers are on a LAN where security is not an issue - like me) what you want to do is VERY simple using Rsync yourself. I know you said in your post you want to avoid the command line BUT sometimes it is unavoidable. I have learned this the hard way using unRAID. So, I am going to show you how simple using the command line to do this is: First, use the Unassigned Devices Plugin to Mount a SMB share to your unRAID Source machine: https://lime-technology.com/forum/index.php?topic=45807.0 You now have your destination (Backup) server mounted within your source server and should have something like this /mnt/disks/backup_nas Now to Rsync. This is all you need: rsync -a /path/to/source/ /path/to/destination/ e.g. I use the following: rsync -a /mnt/user/nas/ /mnt/disks/backup_nas/nas -a is for archive mode (implies recursive, copy symlinks as symlinks, preserve owner, modification times, group, owner, special and device files) Note: the trailing '/' on the end of the source path is important. With this the contents of the source directory will be duplicated into the destination directory. Without it the whole hierarchy of the source directory will be recreated within the destination directory. optional commands (There are heaps more than this BUT given what you have asked to be able to do I am trying not to overwhelm): rsync -a --progress /path/to/source/ /path/to/destination/ --progress shows progress of the file transfers on the command line rsync -a --progress --dry-run /path/to/source/ /path/to/destination/ --dry-run tells rsync to not do any file transfers, instead it will just report the actions it would have taken. Note: ALWAYS do a --dry-run BEFORE doing ANYTHING with your data. Look at the output. Test scenario's. When you're happy, remove the option from the command. Once you have a command that you are happy with, you can easily add this as a cron job utilising the power of dynamix. You do this on the command line, but once again it is easy: nano /boot/config/plugins/dynamix/dailybackup.cron If the "dailybackup.cron" file exists it will edit it. If not, it will create it. Paste the following into this file: # Perform a daily backup of my main share at 1:30am 30 1 * * * rsync -a /mnt/user/nas/ /mnt/disks/backup_nas/nas |& logger <CTRL> + <X> to exit and Save output. The cron Job is now saved. I have noticed that the dynamix cron files are not loaded just because you create a file BUT you can force this. Just go into the Settings>Scheduler AND make a change (so the Apply Button gets un-greyed out) and change it back (Apply Button remains un-greyed out) and Hit Apply (essentially not changing ANYTHING) then the cron file gets loaded. Voila. Done. As we have added |& logger to the command in the cron file, this will add the output of the command line to the unRAID syslog. Now, after all that I feel bad I haven't presented a solution that uses a GUI. So here goes. If you're willing to utilise the resources of a Windows VM to do this for you. I have used this before BUT have just made the switch to Rsync. SyncBack FREE is a GREAT tool: http://www.2brightsparks.com/welcome/backup/freeware.html?gclid=CN2xoNzRzcsCFQoQvQodcgUJ3A It's as simple as installing. Identifying a source. Identifying a destination. Give it some copy instructions (via tick boxes and switches). Set a schedule. Test it. Start it. Leave it alone. Thats great! thank you for this. Quick question though, if I wanted unraid to send me a notification when this cron job starts and finishes, is there anyway to add that capability to this script?
  11. I have one connected via dual link to a M1015 and so far its working well. I have 8 drives currently (including parity) and net between 93-105MBs during parity sync. Overall ive been happy. There are 3 versions of this board, a yellow 1.5GBs version, green 3GBs version and the new 12GBs version. I have the green like I said, it works well. Take a look at this post over at STH... It has lots of info reguarding that card. https://forums.servethehome.com/index.php?threads/hp-sas-expander-wiki.146/
  12. Not sure, but I can confirm that the pike 2008 card is
  13. There's a lovely option these days with enterprise level motherboards from Asus. The illusive PIKE Slot. I say illusive because there's not much information out there about them. Or How to flash them should you need to. Basically it's a proprietary pcie slot that when populated allows access to 8 extra SATA3/SAS2 ports on the motherboard. It's basically the same thing as an AOC-MV8 or M1015 but without taking up a normally placed PCIE slot on the mobo, pretty sweet IMHO. Any way, these motherboards take several different flavors of the PIKE card, however for us unRAID users, we'll focus on the PIKE2008 because this comes with a rebranded version of LSI SAS2008 9220-8i that natively passes through to unRAID.... Until you plug in another LSI SAS2008 card... Then there's this lovely bug that makes this card unstable and you'll have to flash new firmware in order to ever see your drives again. So if you're ever as unlucky as me, (For referance I found this with a PIKE 2008 & M1015 on the Asus P8B-E 4/L Motherboard) Here's the walkthrough. 1. Get the SAS2008 files here -> http://forums.laptopvideo2go.com/topic/29059-lsi-92xx-firmware-files/ 2. Download the 9211-8I firmware files from LSI -> http://www.avagotech.com/cs/Satellite?c=Page&childpagename=AVG2%2FAVG2_Layout&cid=1211128364570&d=Touch&locale=avg_en&pagename=AVG2_Wrapper 3. Head over to here -> https://svn.code.sf.net/p/edk2/code/...FullShell/X64/ and download that file, rename it to shellx64.efi 4. Create a usb, dos bootable, I would recommend using Rufus (do a google search) 5. Throw the SAS2008 files on the usb, replacing the firmware (9211it.bin) and bios (mptsas2.rom) you grabbed from LSI (I've tested and confirmed that P15, P16 & P19 all work with unraid 6.1 & 6.19) then make a subfolder /boot/eufi/ and place shellx64.efi inside the folder tree. 6. Write down the 16 digit sas adress on the back of the PIKE card 7. Reinstall PIKE card, Remove all drives, other adapters and boot into the usb 8. Backup the current firmware from the card megarec -writesbr 0 pike2008.sbr 9. Clear the card megarec -writesbr 0 sbrempty.bin megarec -cleanflash 0 10. Reboot server (ctrl+alt+delete) and enter the motherboard bios, go to the exit tab and choose 'Launch EFI Shell from filesystem device' This will launch the shellx64.efi that you provided on the usb. 11. Navigate to the root of the usb by typing Fs0: 12. Write the new firmware/bios to the card. sas2flash -o -f 2118it.bin -b mptsas2.rom You have an option to skip the part of the code (-b mptsas2.rom) in order to speed up boot times, however if your using more than one HBA I would strongly encourage you to keep it. 13. Readdress the card sas2flash -o sasadd xxxxxxxxxxxxxxxx X's being the SAS adress from the back of your card. Reboot and enjoy! -- side note, if you chose to keep the mptsas2 bios, and have another SAS2008 HBA, now would be a good time to go into the bios and set the boot order of the cards. My server would only load one card at random until I did. --
  14. Update: 1. New PSU is installed 2. All HD's removed from hot swap bays and physically connected to MB. 3. Installed plugin: Unassigned Devices & verified data is good on disk 5 & 6 4. Shrunk array to 4 known 'good' disks. 4. Rebuild parity. 5. Precleared spare WD Red 3 TB 6. Added new drive to array and migrated disk 5 data to new drive via Unassigned Devices plugin 7. Using the old disk 5 as my spare, repeat step 5 & 6 for disk 6 Now I'm back in business with the old disk 6 sitting in standby as my spare. One question, I'd like to test the hot swap cages for bad power and sata links. Whats the best way to go about this? Would a 2 pass preclear on a 120G drive in each bay be enough to test these cages? The cages are both Norco SS-500. @trurl @itimpi thanks so much guys, you helped me save over 5k family pictures and home movies
  15. Just cataloged my drives and turns out that they span across both my hot swap drive cages. So my plan is to pick up a new psu and cable the drives directly to the motherboard... and test from there using preclears while incrementally adding the hot swap bays one by one. Just picked up aCorsair HX750i, once I get it here and installed I'll run the tests on a spare disk I have THEN try to save the drives and re-add them. This is so much fun I can't wait to get started (insert sarcasm here) Thank you guys so much I'll keep updating as this progresses