Cleaning out Docker image


dalben

Recommended Posts

  • 3 weeks later...

So that seems to be 2 Official LT Dockers that have excessive size growth?

Plex and BTSync.

 

It's not limited to LT's containers to be fair, but yeah, all of their containers are problematic...

 

Hopefully though this will provide an impetus to upgrade the docker version and implement log rotation in 6.2....

 

And has solved the mystery of the shrinking space in docker.img

Link to comment

.. I feel lost with the docker size... I keep delete, re-enable, and increasing the docker size.

Last night, I delete it and re-enable again. I start from 30GB of size, but it prompt me 70% full in 30mins. then, I change it to 70GB. When I woke up this morning, I saw the server sent me warning/alert email in every 1 min until it became 100% full..

 

LT need to advise how to fix this problem. it is non-sense!!

Link to comment

.. I feel lost with the docker size... I keep delete, re-enable, and increasing the docker size.

Last night, I delete it and re-enable again. I start from 30GB of size, but it prompt me 70% full in 30mins. then, I change it to 70GB. When I woke up this morning, I saw the server sent me warning/alert email in every 1 min until it became 100% full..

 

LT need to advise how to fix this problem. it is non-sense!!

What else have you tried to fix your problem? If it's growing that fast you need to figure out what is wrong with the way you have set your dockers up. Something is writing data inside docker.img instead of outside it where it belongs. Try one docker at a time and see which ones are making it grow and maybe we can look more closely at how it's configured both in the docker setup and in the application itself.
Link to comment

I think I finally fix this problem, the problem should be from BT sync, I uncheck the log box in BT sync setup. after that, no utilization prompt now.

This fixed it for me too. I unchecked turn off debug logging in the preferences window, then clicked the edit sync docker from the unRAID docker menu clicked save without any changes, then my usage went from 78% down to 17% immediately and returned to normal.

 

So [sOLVED] for me at least. Thank you kvinmok you relieved my stress level. I owe you a beer.

Link to comment
  • 4 weeks later...

Got some unRAID notifications about my 10GB docker image filling up. I immediately moved it to 20GB as I had no time to troubleshoot. As binhex said, I ran

find /var/lib/docker/btrfs -type f -size +50000k -exec ls -lh {} \; | awk '{ print $9 ": " $5 }'

 

Here's the output

/var/lib/docker/btrfs/subvolumes/b38b06db10ccc8fd05ebb5fb15f23e94f17cfaf5e124ea90d62610749d704221/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/b38b06db10ccc8fd05ebb5fb15f23e94f17cfaf5e124ea90d62610749d704221/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/b38b06db10ccc8fd05ebb5fb15f23e94f17cfaf5e124ea90d62610749d704221/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/38adf050565115ed2c14db8ed91aeef65f881af583de53c432851f7438661e51/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/38adf050565115ed2c14db8ed91aeef65f881af583de53c432851f7438661e51/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/38adf050565115ed2c14db8ed91aeef65f881af583de53c432851f7438661e51/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/a689d4cb884deb7588423736dc714bef11986091341c119a3978ea532d9286a2/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/a689d4cb884deb7588423736dc714bef11986091341c119a3978ea532d9286a2/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/a689d4cb884deb7588423736dc714bef11986091341c119a3978ea532d9286a2/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/19ba52876fd255115230f10515bcb137ab247ead00a3c59404016d39257f2a56/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/19ba52876fd255115230f10515bcb137ab247ead00a3c59404016d39257f2a56/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/19ba52876fd255115230f10515bcb137ab247ead00a3c59404016d39257f2a56/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/37863c4dd0fb24fa7a20609eb761e048abdd08bcdbee768ffa81073cd0be5fd1/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/37863c4dd0fb24fa7a20609eb761e048abdd08bcdbee768ffa81073cd0be5fd1/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/37863c4dd0fb24fa7a20609eb761e048abdd08bcdbee768ffa81073cd0be5fd1/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/e037d9a8a8890d8dd88b6747e5b9885779bdad01ed59748488905a746b061849/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/e037d9a8a8890d8dd88b6747e5b9885779bdad01ed59748488905a746b061849/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/e037d9a8a8890d8dd88b6747e5b9885779bdad01ed59748488905a746b061849/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/8fee7ffda240ef177aef9d6f4a5644954665bd7cb0090068cc2e9c629b5bb11c/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/8fee7ffda240ef177aef9d6f4a5644954665bd7cb0090068cc2e9c629b5bb11c/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/8fee7ffda240ef177aef9d6f4a5644954665bd7cb0090068cc2e9c629b5bb11c/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/a09aba96f9f83e6c8670c01b62aa92d6185f7e285b20350dbf14c2cac8aae9b0/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/a09aba96f9f83e6c8670c01b62aa92d6185f7e285b20350dbf14c2cac8aae9b0/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/a09aba96f9f83e6c8670c01b62aa92d6185f7e285b20350dbf14c2cac8aae9b0/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/9d1b40ea821f4dc21118bc77da66fdcd0a2b12293f9e81974f57e144935112cf/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/9d1b40ea821f4dc21118bc77da66fdcd0a2b12293f9e81974f57e144935112cf/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/9d1b40ea821f4dc21118bc77da66fdcd0a2b12293f9e81974f57e144935112cf/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/9d1b40ea821f4dc21118bc77da66fdcd0a2b12293f9e81974f57e144935112cf/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/e542330e626057dd6e2681067a58f2cc73248fe721529ee6e0603ecbe69105bb/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/e542330e626057dd6e2681067a58f2cc73248fe721529ee6e0603ecbe69105bb/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/e542330e626057dd6e2681067a58f2cc73248fe721529ee6e0603ecbe69105bb/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/e542330e626057dd6e2681067a58f2cc73248fe721529ee6e0603ecbe69105bb/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/e542330e626057dd6e2681067a58f2cc73248fe721529ee6e0603ecbe69105bb/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/e542330e626057dd6e2681067a58f2cc73248fe721529ee6e0603ecbe69105bb/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/9eabfec50eb264fb383215620e777d7f2046aa24aade482bfa1bf859a394e6ec/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/9eabfec50eb264fb383215620e777d7f2046aa24aade482bfa1bf859a394e6ec/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/9eabfec50eb264fb383215620e777d7f2046aa24aade482bfa1bf859a394e6ec/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/9eabfec50eb264fb383215620e777d7f2046aa24aade482bfa1bf859a394e6ec/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/9eabfec50eb264fb383215620e777d7f2046aa24aade482bfa1bf859a394e6ec/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/9eabfec50eb264fb383215620e777d7f2046aa24aade482bfa1bf859a394e6ec/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/24d22d6ecd3f1932f7776f7cebc8cb597a44b5c4debb9c420a11e2dbe403e8c4/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/24d22d6ecd3f1932f7776f7cebc8cb597a44b5c4debb9c420a11e2dbe403e8c4/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/24d22d6ecd3f1932f7776f7cebc8cb597a44b5c4debb9c420a11e2dbe403e8c4/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/24d22d6ecd3f1932f7776f7cebc8cb597a44b5c4debb9c420a11e2dbe403e8c4/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/24d22d6ecd3f1932f7776f7cebc8cb597a44b5c4debb9c420a11e2dbe403e8c4/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/24d22d6ecd3f1932f7776f7cebc8cb597a44b5c4debb9c420a11e2dbe403e8c4/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/27f66c782869b32b3c9100c7903fabaec7d115be2320e2a5a91d5fad5daa40c0/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/27f66c782869b32b3c9100c7903fabaec7d115be2320e2a5a91d5fad5daa40c0/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/27f66c782869b32b3c9100c7903fabaec7d115be2320e2a5a91d5fad5daa40c0/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/27f66c782869b32b3c9100c7903fabaec7d115be2320e2a5a91d5fad5daa40c0/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/27f66c782869b32b3c9100c7903fabaec7d115be2320e2a5a91d5fad5daa40c0/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/27f66c782869b32b3c9100c7903fabaec7d115be2320e2a5a91d5fad5daa40c0/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/80bb1c7319ca174f1e3944e287ebcd24555efd99dba8b4ebe48c8866979d21d9/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/80bb1c7319ca174f1e3944e287ebcd24555efd99dba8b4ebe48c8866979d21d9/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/80bb1c7319ca174f1e3944e287ebcd24555efd99dba8b4ebe48c8866979d21d9/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/80bb1c7319ca174f1e3944e287ebcd24555efd99dba8b4ebe48c8866979d21d9/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/80bb1c7319ca174f1e3944e287ebcd24555efd99dba8b4ebe48c8866979d21d9/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/80bb1c7319ca174f1e3944e287ebcd24555efd99dba8b4ebe48c8866979d21d9/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/574b42d064275af3341b6d8bbaf91b883277a6f4c5e1729563f59b5438c79c04/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/574b42d064275af3341b6d8bbaf91b883277a6f4c5e1729563f59b5438c79c04/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/574b42d064275af3341b6d8bbaf91b883277a6f4c5e1729563f59b5438c79c04/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/574b42d064275af3341b6d8bbaf91b883277a6f4c5e1729563f59b5438c79c04/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/574b42d064275af3341b6d8bbaf91b883277a6f4c5e1729563f59b5438c79c04/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/574b42d064275af3341b6d8bbaf91b883277a6f4c5e1729563f59b5438c79c04/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/918bfe812f5cdbf9ccf397080fd7bbc4880b55b96801a5dd4b125e7f9dd25d46/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/918bfe812f5cdbf9ccf397080fd7bbc4880b55b96801a5dd4b125e7f9dd25d46/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/918bfe812f5cdbf9ccf397080fd7bbc4880b55b96801a5dd4b125e7f9dd25d46/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/918bfe812f5cdbf9ccf397080fd7bbc4880b55b96801a5dd4b125e7f9dd25d46/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/918bfe812f5cdbf9ccf397080fd7bbc4880b55b96801a5dd4b125e7f9dd25d46/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/918bfe812f5cdbf9ccf397080fd7bbc4880b55b96801a5dd4b125e7f9dd25d46/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/1b015eb8389fb6114094390e2751e0c8cf2cb201fbb583663a4f693f0ea440ad/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/1b015eb8389fb6114094390e2751e0c8cf2cb201fbb583663a4f693f0ea440ad/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/1b015eb8389fb6114094390e2751e0c8cf2cb201fbb583663a4f693f0ea440ad/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/1b015eb8389fb6114094390e2751e0c8cf2cb201fbb583663a4f693f0ea440ad/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/1b015eb8389fb6114094390e2751e0c8cf2cb201fbb583663a4f693f0ea440ad/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/1b015eb8389fb6114094390e2751e0c8cf2cb201fbb583663a4f693f0ea440ad/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05-init/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05-init/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05-init/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05-init/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05-init/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05-init/unifi_sysvinit_all.deb: 205M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/dl/firmware/UGW3/4.3.9.4843893/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/dl/firmware/UGW4/4.3.9.4843895/upgrade.tar: 73M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/journal/prealloc.1: 1.0G
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/journal/prealloc.2: 1.0G
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/journal/j._0: 1.0G
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/local.0: 64M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/ace.0: 64M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/ace.1: 128M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/ace_stat.0: 64M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/usr/lib/unifi/data/db/ace_stat.1: 128M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/var/cache/oracle-jdk8-installer/jdk-8u72-linux-x64.tar.gz: 173M
/var/lib/docker/btrfs/subvolumes/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05/unifi_sysvinit_all.deb: 205M

 

What's with all the subcontainers that seemingly have the same JDK files over and over?

 

Here's my installed docker containers

UniFi (/docker/bcddb0daaa8e2c63e8514fb2b6c4195823ea7b434bbd87bc3e05f47e6132ee05)
PlexMediaServer (/docker/8bc8205222ee9e8136a41e423c6b719e2351e5d6d0e773dbfb370bf23c0017bf)
sickrage (/docker/3d739033c7d2d0f6129acb04cdedc6f9a7bd4e2f50014344d5d1b3ce275f4054)
binhex-sabnzbd (/docker/9b657da4173b8dbc0a01a399e69cb652bb48f4c1ff6c3228a20567086f5ffd8f)
Observium (/docker/541f6adb51e4304211455477cd07df872faf5a761355594fe131a09d1dad86e1)
CouchPotato (/docker/b178cf88d7a5990aeac70431181061592ace6df29d472f4463e2bbc9b27b7e07)
cadvisor (/docker/610e9def5d7ad1ffcb9e8df4fea87195e3afce25a65257a6065664e8a089b16e)
plexpy (/docker/98bc2c5c27d4a752149783731dd3e9e7f94f10c25ae51b365f2980336c0985c4)

Link to comment

Following up. Did some house cleaning using information from this post: https://github.com/docker/docker/issues/3894

 

Used binhex's command in the post above:

find /var/lib/docker/btrfs -type f -size +50000k -exec ls -lh {} \; | awk '{ print $9 ": " $5 }'

 

I took the subcontainer results and removed the old ones that didn't match my current docker containers using this command:

 

sudo btrfs subvolume delete /var/lib/docker/btrfs/subvolumes/CONTAINERSTRINGNUMBERHERE

 

 

Hopefully that does the trick.

Link to comment
  • 1 month later...

I'm getting this warning now as well.  I tried cAdvisor, but as unRAID kept posting utilization increase notices the cAdvisor-reported sizes of my containers stayed static.  I tried the find command noted above, but didn't get much:

 

root@Hyperion:~# find /var/lib/docker/btrfs -type f -size +50000k -exec ls -lh {} \; | awk '{ print $9 ": " $5 }'
/var/lib/docker/btrfs/subvolumes/ebbd21529e4613beba6f7607487737c1e52dc0cb84ec0931c5db9af4387f27ad/usr/lib/jvm/java-7-oracle/jre/lib/rt.jar: 60M
/var/lib/docker/btrfs/subvolumes/eaab34e28f71a2dc3cb1be60dcf82a1fb67356fb189ce0fde94573c2048cb624/usr/share/icons/mate/icon-theme.cache: 73M
/var/lib/docker/btrfs/subvolumes/f529fb50a329d4f84eb0408e726fbb43cce3d73a0aa2b00863b8db5bf7b83f4b/usr/share/icons/mate/icon-theme.cache: 73M
/var/lib/docker/btrfs/subvolumes/c0f13c41287cc25b75f7abcd264afc18f873683b041548b7771842102bdf49aa/usr/lib/jvm/java-7-oracle/jre/lib/rt.jar: 60M
/var/lib/docker/btrfs/subvolumes/9afad1d1ff13d88787575af2abb58db3259e170bfc1ecb6f0f983c82e0663aee/usr/lib/jvm/java-7-oracle/jre/lib/rt.jar: 60M
/var/lib/docker/btrfs/subvolumes/4abc20213697e28d534019b5efb7c486cf1c86b090182281345aa44d3aac62bd/usr/lib/jvm/java-7-oracle/jre/lib/rt.jar: 60M
/var/lib/docker/btrfs/subvolumes/2fc900c39351bb8332117d23522c747aad386dde51e5a84f0c732644a589dc40/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/2fc900c39351bb8332117d23522c747aad386dde51e5a84f0c732644a589dc40/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/76d5ba319f723928c3c589f2ffb858ff9f83e927a4e97a2e98f5ca36e6ac99a9/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/76d5ba319f723928c3c589f2ffb858ff9f83e927a4e97a2e98f5ca36e6ac99a9/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/88392dc0830b3019a7cc463efcc2e672b606ed78b8e634bfaafeef1117eeda28/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/88392dc0830b3019a7cc463efcc2e672b606ed78b8e634bfaafeef1117eeda28/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/323a75e039f3d9a1fb101e897eb1474b87e9f495dce90fe1a8ab202bbe6306a4/usr/share/icons/mate/icon-theme.cache: 73M
/var/lib/docker/btrfs/subvolumes/78cb538c3c7f431ca144fcdebab693bfeecc91943f107f77a7fb75e45d10b28b/usr/share/icons/mate/icon-theme.cache: 73M
/var/lib/docker/btrfs/subvolumes/865df05ce0be27ceda437774ac8d3a0640144455acdcd88d4e0cdb8b873f069c/usr/share/icons/mate/icon-theme.cache: 73M
/var/lib/docker/btrfs/subvolumes/cc39a5d4b99853b010d74c325232c4d385eb50dd387c1176ed4b699bbc88838b-init/usr/share/icons/mate/icon-theme.cache: 73M
/var/lib/docker/btrfs/subvolumes/cc39a5d4b99853b010d74c325232c4d385eb50dd387c1176ed4b699bbc88838b/usr/share/icons/mate/icon-theme.cache: 73M
/var/lib/docker/btrfs/subvolumes/1d710cf1ee75d67ec7416ec5ef566ea44617ae511ac1ba6b2063d308f822872a/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/1d710cf1ee75d67ec7416ec5ef566ea44617ae511ac1ba6b2063d308f822872a/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/8647eba2054fe2e30ee321beb28fcfb6592c34439ef92e909da5ad566bd72d0f/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/8647eba2054fe2e30ee321beb28fcfb6592c34439ef92e909da5ad566bd72d0f/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/2d02fe93d96ee71cd85d6dcab837d420ae62e4cfb6f25f88dff2da85d35f27a0/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/2d02fe93d96ee71cd85d6dcab837d420ae62e4cfb6f25f88dff2da85d35f27a0/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/2a5f568fe0c518e4902a34d720f425ef0b8b426b609ef094a863fccd5c713758-init/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/2a5f568fe0c518e4902a34d720f425ef0b8b426b609ef094a863fccd5c713758-init/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M
/var/lib/docker/btrfs/subvolumes/2a5f568fe0c518e4902a34d720f425ef0b8b426b609ef094a863fccd5c713758/usr/lib/jvm/java-8-oracle/jre/lib/amd64/libjfxwebkit.so: 55M
/var/lib/docker/btrfs/subvolumes/2a5f568fe0c518e4902a34d720f425ef0b8b426b609ef094a863fccd5c713758/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar: 63M

 

I'm a little unclear on the actual mountpoint of the image, though.  If I hop up a directory, I found these files which seems to be exceedingly large:

root@Hyperion:/var/lib/docker/containers# find /var/lib/docker/containers -type f -size +50000k -exec ls -lh {} \; | awk '{ print $9 ": " $5 }'
/var/lib/docker/containers/7065ca451d0b80ff1e4531eae9e6b5bc14240098f5df6f2917968ab571cb4da9/7065ca451d0b80ff1e4531eae9e6b5bc14240098f5df6f2917968ab571cb4da9-json.log: 1.8G
/var/lib/docker/containers/33f597123d2ead97028b0b9fd0bc3e41cf17e2ce46fbecda7dbb1f6bbd182ae3/33f597123d2ead97028b0b9fd0bc3e41cf17e2ce46fbecda7dbb1f6bbd182ae3-json.log: 1.9G

Could those be the issue?  Are they safe to delete?  The strings correspond to my currently-running SABnzbd and CrashPlan containers.  This same log on other containers is only a few hundred kB.

 

Finally, I noticed that I have just over a hundred subvolumes.  I only have 5 docker containers running.  Is that normal?  Each appears to be consuming a good chunk of space, but it's hard to determine what each really is.  Spencers posted a method to delete them up above, but I'm not sure which ones are safe to delete.  Can I delete all of them without a string matching a currently-running container?  I'm kind of confused why this isn't handled automatically.  Deleting so many of these is going to be tedious.

 

Then it just stopped growing this morning without me really taking any action.  Not sure what's going on.

Link to comment

Common complaint around the web regarding the disk usage of docker as a whole.  Definitely not LT's issue. 

 

Instead of manually going through and deleting subvolumes, your best course of action is to completely delete the docker.img and then re-add the apps either through CA's previous apps section or the my* templates.  Everything will be back exactly the same way it was before, but your usage will be lower.

 

As far as those two logs are concerned, you're probably ok to delete them, but you might want to check the debugging settings (or log verbosity settings) within those containers to see if its logging everything or just what you're interested in.

 

Realistically, I think the functional size of anyone's docker.img file should be 20G at the minimum.  LT's default of 5G is way too small, and at 10G you're pushing your luck

Link to comment

Realistically, I think the functional size of anyone's docker.img file should be 20G at the minimum.  LT's default of 5G is way too small, and at 10G you're pushing your luck

LT's default is 10GB, not 5GB.

I have around 10 dockers, and had to increase mine from 10GB to 15GB, standard should be 20GB so people dont have to do that.

Link to comment

15GB seemed like it was going to be enough (CA reports a total of ~2.5GB in active containers).  I didn't realize how wasteful Docker was with disk space in general when I got started.  I'll increase the size.

 

Is there a guide for deleting the image and starting over without losing settings?  I couldn't fine much of anything on CA previous apps or my* templates.  I guess I could screencap my drive mappings (basically the extent of the "config" for the containers I'm using), but if there's an easier way I'll use it.

Link to comment

I have 4 docker containers that handle irc bots, usenet downloads, torrent downloads, and pushing items to the Tivo. My Docker image file is a consistent 1.7GB. After months of usage it may hit 1.8GB. I really don't know what dockers you're using or why they're so large.

 

Link to comment

Initially, on some of those (deluge?) it would appear that you've got them storing data within the docker.omg file instead of outside it

 

Sent from my LG-D852 using Tapatalk

I don't think so.

I did have deluge to download to docker.img at first, but quickly changed that.

I have nuked my docker.img later because of a cAdvisor bug, so there is not anything left from that.

Deluge is not downloading anything to my docker.img.

Link to comment
  • 1 month later...

So, I'm having the same problem (docker image filling up), and unfortunately CAdvisor hasn't been any help as my container sizes don't seem to be changing. I have however been able to isolate the source of the problem by going through all my containers that seem to have high memory usage and larger container sizes and updating them (edit > save) and waiting until my docker utilization goes back to normal.

 

It seems that my problem is coming from gfjardim's  Crashplan docker. I am using crashplan to backup my entire server (unlimited account), so it is moving a lot of data, but it doesn't seem to keep logs, so I'm unsure what could be causing the docker image to fill up. Any ideas?

Link to comment

So, I'm having the same problem (docker image filling up), and unfortunately CAdvisor hasn't been any help as my container sizes don't seem to be changing. I have however been able to isolate the source of the problem by going through all my containers that seem to have high memory usage and larger container sizes and updating them (edit > save) and waiting until my docker utilization goes back to normal.

 

It seems that my problem is coming from gfjardim's  Crashplan docker. I am using crashplan to backup my entire server (unlimited account), so it is moving a lot of data, but it doesn't seem to keep logs, so I'm unsure what could be causing the docker image to fill up. Any ideas?

http://lime-technology.com/forum/index.php?topic=45249.0

 

SM-N9000Q cihaz?mdan Tapatalk kullan?larak gönderildi

 

 

Link to comment

http://lime-technology.com/forum/index.php?topic=45249.0

 

SM-N9000Q cihaz?mdan Tapatalk kullan?larak gönderildi

 

I've already tried this, but Crashplan's logs aren't particularly large. And as I said in my post there don't seem to be any logs internal to crashplan that I can clear or limit the size of.

That solves my issue with btsync and couchpotato.

 

SM-N9000Q cihaz?mdan Tapatalk kullan?larak gönderildi

 

 

Link to comment
  • 1 month later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.