Version 5 Development > Other
Mover causes complete crash (5b14)
ajburnet:
Just noticed that the folder caching menu in settings (running SimpleFeatures GUI) has the 'suspend during mover process' enabled so I assume it is being disabled before the mover runs, i.e. same outcome as your script?
I've ordered more memory but I assume it just uses an available amount for caching so I won't see any benefit - or is it a set maximum value is utilises limited by the levels / files it caches?
My apps are all running out of user/local - isn't that in RAM? Might be worth running out of a temp file on the cache drive I guess and setting up a swap-file. I'll see if that helps. If it doesn't I'll disable cache dirs to test.
I noticed that Plex was using /tmp so will change that to the cache drive.
Fingers crossed & thanks!! :o
WeeboTech:
if all your apps are on /usr/local with plex using /tmp and cache_dirs running, I can totally understand why you are having out of memory issues.
You can add more ram, but you will still have the same issues if you are running cache_dirs and massive rsync at the same time.
Some things you can do.
make a swap partition on your cache drive. make it the full size of ram if possible.
mount a tmpfs on /tmp
This allows /tmp to be used and also swapped out safely.
you mention user/local .
Did you mean /mnt/user/local or /usr/local
if you are talking about /usr/local then yes you are putting everything in ram.
if this is how you are using it then I would
rename /usr/local to /usr/local.d
mkdir /usr/local
mount tmpfs /usr/local
do a rsync -a --remove-sent-files /usr/local.d/ /usr/local
this has the effect of creating a contained ramdisk on /usr/local that can be swapped out if you have memory pressure.
The root initrootfs cannot be swapped out, but tmpfs can.
ajburnet:
Thanks for that - really appreciate it. I'm about to throw the damn thing away if it wasn't so good when it's working!!
I created a swap file (2.5GB, I tried a 4GB one which it didn't like...) and have moved both plex and sabnzbd so they are running from the cache drive (couch potato and sick beard are running from usr/local as they would not install elsewhere happily - this seems to be a common setup for those apps. They do have data drives set on the cache however.
I invoked the mover once (with nothing to sync) and it was fine. Second time and it's crashed again!
It still seems to be using a lot of RAM, or is this normal - I wasn't expecting it to use the swap when nothing much is happening!
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
0 1 2580 124760 106676 3336028 0 4 336 4001 1499 1904 5 8 31 56
total used free shared buffers cached
Mem: 3887512 3762884 124628 0 106676 3336028
-/+ buffers/cache: 320180 3567332
Swap: 3583996 2580 3581416
Also, as soon as cached_dirs are enabled and the mover script runs it crashed (see below). With cached_dirs disabled it appears to be okay..
Message from syslogd@unRAID at Sun Feb 26 23:23:18 2012 ...
unRAID kernel: Call Trace:
Message from syslogd@unRAID at Sun Feb 26 23:23:18 2012 ...
unRAID kernel: Code: 8b 08 85 c9 89 4d f0 75 16 8b 7d dc 8b 4d ec 50 89 f0 89 fa e8 5a f6 ff ff 89 45 f0 58 eb 30 8b 46 14 8b 5d f0 8b 7d e8 8b 55 e8 <8b> 04 03 47 89 7d e0 89 f9 89 45 e4 89 c3 8b 3e 8b 45 f0 64 0f
Message from syslogd@unRAID at Sun Feb 26 23:23:18 2012 ...
unRAID kernel: Process cache_dirs (pid: 23741, ti=d3062000 task=ef0af600 task.ti=d3062000)
Message from syslogd@unRAID at Sun Feb 26 23:23:18 2012 ...
unRAID kernel: EIP: [<c107d9a0>] __kmalloc+0xbb/0xff SS:ESP 0068:d3063ea8
Message from syslogd@unRAID at Sun Feb 26 23:23:18 2012 ...
unRAID kernel: Stack:
Message from syslogd@unRAID at Sun Feb 26 23:23:18 2012 ...
unRAID kernel: Oops: 0000 [#3] SMP
Appreciate you're help. I've spent many days trying to sort this so a BIG THANK YOU!
Thanks,
Alex.
ajburnet:
I can't reboot now - it says out of memory, no killable processes!
Halp!
WeeboTech:
Shutdown the other processes. see if you can reboot after that.
do a dh -hs /usr/local (how much space is being used on this directory?)
You may want to try mounting a tmpfs on this directory before you install your apps.
You can also try adding more ram to the system.
I have 8GB.
but if there's nothing to move via mover, it should not crash the system.
The amount of swap being used is small, but then again, you must have rebooted very recently to enable swap and move the apps, so that means right away the kernel sees the need to move pages to swap.
It's a small amount but there's pressure for memory.
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version