G Speed Posted July 1, 2013 Share Posted July 1, 2013 If this goes in another location please move it... I'm trying to figure out how to, move files from my qnap to unraid From everything I read, the best/fastest way to do this is rsync But what I want to do is transfer QNAP 192.168.0.182/share/MD0_DATA/Download/Transfer to Unraid 192.168.0.191/New If anyone could help I would appreciate.. Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 Entering in my login information does not seem to work? Quote Link to comment
garycase Posted July 1, 2013 Share Posted July 1, 2013 I don't use rsync, but I assume you simply type a command in the form "rsync <source> <dest> on either of the boxes (QNap or UnRAID) and, as long as they're properly formed, it should do the topies. http://rsync.samba.org/ftp/rsync/rsync.html HOWEVER ... assuming you have parity enabled on the UnRAID box AND that you're running a Gb network, it should be just as fast to simply do the copy from a Windows client using Windows Explorer, since the network is more than twice as fast as the UnRAID write speeds. ... unless you're using a cache drive. But even then it will still be pretty fast. Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 I don't use rsync, but I assume you simply type a command in the form "rsync <source> <dest> on either of the boxes (QNap or UnRAID) and, as long as they're properly formed, it should do the topies. http://rsync.samba.org/ftp/rsync/rsync.html HOWEVER ... assuming you have parity enabled on the UnRAID box AND that you're running a Gb network, it should be just as fast to simply do the copy from a Windows client using Windows Explorer, since the network is more than twice as fast as the UnRAID write speeds. ... unless you're using a cache drive. But even then it will still be pretty fast. Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol Quote Link to comment
garycase Posted July 1, 2013 Share Posted July 1, 2013 Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol Ahh ... that would be a problem. I assumed you'd have at least one hard-wired client (desktop or laptop) with a Gb NIC. Obviously if that's not the case, my comment r.e. the speed isn't correct, as you have another bottleneck in the path (the wireless data rate). Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol Ahh ... that would be a problem. I assumed you'd have at least one hard-wired client (desktop or laptop) with a Gb NIC. Obviously if that's not the case, my comment r.e. the speed isn't correct, as you have another bottleneck in the path (the wireless data rate). Yup, that's why it looks like rsync is the onlyway.. so rsync on qnap is enabled.. but not sure about unraid.. looks like I may need to add on rsyncd script? Quote Link to comment
garycase Posted July 1, 2013 Share Posted July 1, 2013 Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol Ahh ... that would be a problem. I assumed you'd have at least one hard-wired client (desktop or laptop) with a Gb NIC. Obviously if that's not the case, my comment r.e. the speed isn't correct, as you have another bottleneck in the path (the wireless data rate). Yup, that's why it looks like rsync is the onlyway.. so rsync on qnap is enabled.. but not sure about unraid.. looks like I may need to add on rsyncd script? As I noted, I don't use it, so I'm not sure => but there IS an rsync package listed in UnMenu's Package Manager ... so I suspect that needs to be installed so the rsync clients on the two boxes can "talk" to each. I suspect you know more about rsync than I do ... and hopefully somebody who knows it well can help you with the setup details if it's more complex than just installing the package. Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 is the qnap expecting to use rsync over ssh or rsync to an rsync server? The rsync command line program is already installed on unRAID. you have to enable the server via daemon or via inetd or install openssh to go that route. Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 Here is how I enable it via script. #!/bin/bash if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi Quote Link to comment
dgaschk Posted July 1, 2013 Share Posted July 1, 2013 This describes my method: http://lime-technology.com/forum/index.php?topic=28299.msg251317#msg251317 Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 is the qnap expecting to use rsync over ssh or rsync to an rsync server? The rsync command line program is already installed on unRAID. you have to enable the server via daemon or via inetd or install openssh to go that route. it's expecting rysnc.. where do I put that script? #!/bin/bash if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 I like to put it in /boot/local/etc/rc.d ( I have a better one that I just found ). I have not used or tested this one in a long time. However it handles the stopping/starting and syncing of the rsyncd.conf file also. you can call it from go with /boot/local/etc/rc.d/rc.rsyncd start #!/bin/sh # Start/stop/restart rsyncd # Start rsync: rsync_start() { rsync /boot/local/etc/rsyncd.conf /etc/rsyncd.conf if [ -x /usr/sbin/rsync ]; then echo "Starting Internet super-server daemon: /usr/sbin/rsync" /usr/sbin/rsync --daemon return fi if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi } # Stop rsync: rsync_stop() { killall rsync rsync /etc/rsyncd.conf /boot/local/etc/rsyncd.conf } # Restart rsync: rsync_restart() { rsync_stop sleep 1 rsync_start } case "$1" in 'start') rsync_start ;; 'stop') rsync_stop ;; 'restart') rsync_restart ;; *) echo "usage $0 start|stop|restart" esac and my basic rsyncd.conf You can disable the log if you like. comment it out. uid = root gid = root use chroot = no max connections = 4 timeout = 600 pid file = /var/run/rsyncd.pid log file = /var/log/rsyncd.log [mnt] path = /mnt comment = /mnt files read only = FALSE Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 I like to put it in /boot/local/etc/rc.d ( I have a better one that I just found ). I have not used or tested this one in a long time. However it handles the stopping/starting and syncing of the rsyncd.conf file also. you can call it from go with /boot/local/etc/rc.d/rc.rsyncd start #!/bin/sh # Start/stop/restart rsyncd # Start rsync: rsync_start() { rsync /boot/local/etc/rsyncd.conf /etc/rsyncd.conf if [ -x /usr/sbin/rsync ]; then echo "Starting Internet super-server daemon: /usr/sbin/rsync" /usr/sbin/rsync --daemon return fi if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi } # Stop rsync: rsync_stop() { killall rsync rsync /etc/rsyncd.conf /boot/local/etc/rsyncd.conf } # Restart rsync: rsync_restart() { rsync_stop sleep 1 rsync_start } case "$1" in 'start') rsync_start ;; 'stop') rsync_stop ;; 'restart') rsync_restart ;; *) echo "usage $0 start|stop|restart" esac and my basic rsyncd.conf You can disable the log if you like. comment it out. uid = root gid = root use chroot = no max connections = 4 timeout = 600 pid file = /var/run/rsyncd.pid log file = /var/log/rsyncd.log [mnt] path = /mnt comment = /mnt files read only = FALSE Once this is all done upon restart does it start? and... for some reason I don't have /boot/local/etc/rc.d just config and pacakges Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 Once this is all done upon restart does it start? and... for some reason I don't have /boot/local/etc/rc.d just config and pacakges you can make the directory mkdir -vp /boot/local/etc/rc.d Then place the script there. put your rsyncd.conf file in /boot/local/etc ( it's expecting the file to be in unix LF delimited format. You may need to convert it with fromdos.) run it once to make sure there are no errors /boot/local/etc/rc.d/rc.rsyncd start If it's good, put that line in your go script. I used to use /boot/custom These days I use /boot/local This stems more from working on so many different systems at work. We tend to make common tree based on facility. which tends to be /(service)/local/etc,bin,var/log,tmp,lib So that's why I choose local vs custom. Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 Once this is all done upon restart does it start? and... for some reason I don't have /boot/local/etc/rc.d just config and pacakges you can make the directory mkdir -vp /boot/local/etc/rc.d Then place the script there. put your rsyncd.conf file in /boot/local/etc ( it's expecting the file to be in unix LF delimited format. You may need to convert it with fromdos.) run it once to make sure there are no errors /boot/local/etc/rc.d/rc.rsyncd start If it's good, put that line in your go script. I used to use /boot/custom These days I use /boot/local This stems more from working on so many different systems at work. We tend to make common tree based on facility. which tends to be /(service)/local/etc,bin,var/log,tmp,lib So that's why I choose local vs custom. want to first of say thanks for the help I'm getting somewhere.. so I did... root@Tower:~# mkdir -vp /boot/local/etc/rc.d mkdir: created directory `/boot/local' mkdir: created directory `/boot/local/etc' mkdir: created directory `/boot/local/etc/rc.d' root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: No such file or directory root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: No such file or directory root@Tower:~# /flash/local/etc/rc.d/rc.rsyncd start -bash: /flash/local/etc/rc.d/rc.rsyncd: No such file or directory root@Tower:~# /flash/local/etc/rc.d/rsyncd start -bash: /flash/local/etc/rc.d/rsyncd: No such file or directory So What I noticed... is boot.. became flash.. not a big deal so I adjusted.. so I changed directory and dropped in the rsyncd... what am I missing? Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc Linux 3.9.6p-unRAID. root@Tower:~# ls -l /boot/local/etc/rc.d/ total 4 -rwxrwxrwx 1 root root 265 2013-07-01 11:41 rsyncd.conf* Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc Linux 3.9.6p-unRAID. root@Tower:~# ls -l /boot/local/etc/rc.d/ total 4 -rwxrwxrwx 1 root root 265 2013-07-01 11:41 rsyncd.conf* put rsyncd.conf in /boot/local/etc put rc.rsyncd in /boot/local/etc/rc.d Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc Linux 3.9.6p-unRAID. root@Tower:~# ls -l /boot/local/etc/rc.d/ total 4 -rwxrwxrwx 1 root root 265 2013-07-01 11:41 rsyncd.conf* put rsyncd.conf in /boot/local/etc put rc.rsyncd in /boot/local/etc/rc.d For some reason still getting root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: No such file or directory Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 telnet in and try the following. fromdos < /boot/local/etc/rc.d/rc.rsyncd > /tmp/rc.rsyncd mv /tmp/rc.rsyncd /boot/local/etc/rc.d/rc.rsyncd ls -l /boot/local/etc/rc.d/rc.rsyncd head /boot/local/etc/rc.d/rc.rsyncd Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 telnet in and try the following. fromdos < /boot/local/etc/rc.d/rc.rsyncd > /tmp/rc.rsyncd mv /tmp/rc.rsyncd /boot/local/etc/rc.d/rc.rsyncd ls -l /boot/local/etc/rc.d/rc.rsyncd head /boot/local/etc/rc.d/rc.rsyncd can't get past first without same error no such file or directory i'm assuming even if the coding format on the inside was wrong it would give me an error based on that. not no file/directory Quote Link to comment
WeeboTech Posted July 1, 2013 Share Posted July 1, 2013 In the image it looks like you put the /boot/local/etc/rc.d/rc.rsyncd script as rc.rsyncd.conf At least it says type CONF and it should not. Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 In the image it looks like you put the /boot/local/etc/rc.d/rc.rsyncd script as rc.rsyncd.conf At least it says type CONF and it should not. yea I was actually just playing with that... let me try and remove Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 In the image it looks like you put the /boot/local/etc/rc.d/rc.rsyncd script as rc.rsyncd.conf At least it says type CONF and it should not. So I.. removed the extension.. obviously a file won't with a two periods.. Tower login: root Password: Linux 3.9.6p-unRAID. root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: /bin/sh^M: bad interpreter: No such file or directory root@Tower:~# fromdos < /boot/local/etc/rc.d/rc.rsyncd > /tmp/rc.rsyncd root@Tower:~# mv /tmp/rc.rsyncd /boot/local/etc/rc.d/rc.rsyncd root@Tower:~# ls -l /boot/local/etc/rc.d/rc.rsyncd -rwxrwxrwx 1 root root 823 2013-07-01 13:11 /boot/local/etc/rc.d/rc.rsyncd* root@Tower:~# head /boot/local/etc/rc.d/rc.rsyncd #!/bin/sh # Start/stop/restart rsyncd # Start rsync: rsync_start() { rsync /boot/local/etc/rsyncd.conf /etc/rsyncd.conf if [ -x /usr/sbin/rsync ]; then echo "Starting Internet super-server daemon: /usr/sbin/rsync" /usr/sbin/rsync --daemon root@Tower:~# Quote Link to comment
G Speed Posted July 1, 2013 Author Share Posted July 1, 2013 First of thanks so much! So rsync is up and running.. I just tested on qnap and now it gives me success.. along with in log Tower rsync[2984]: connect from 192.168.0.182 (192.168.0.182) <--- My Qnap Problem is.. no folders are listed? It shows connecting... then it disappears and I see nothing Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.