sonic_installer believes it successfully installed an image even though installation failed due to no space left on device

[jleveque]

sonic_installer believes it successfully installed an image even though installation failed due to no space left on device. This can easily lead to bricked devices.

tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/c3a684c7b1c9267942980e3e25b5f64dbf32ba62443700f7761fd680a3d2028d: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/43ca488eea2e72224f7c89a4bf5e8d4e3562155a08c18f5315a1b3682ba28cfa: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/5873e02375f06de23ce8f72a1a2c4fa482a35fecf890a27e30ead5bb678d3295: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/fb1777a71e888fb68c8c08351c7f937cb59b5b1185bec947b7385487ac28d87a: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/110f2fc7899a519912c0686fbaaca2381aef15908f02e86fa4b4da94924d70f6: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/c0d11c08a6f30963a09473b36f43ca8155e59d381c9281b2af166ee18461f39c: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/a5d88a51ba4b9b1542b62325eab57aae8fbfc1c6ee1ce8103d3b527bf35028bb: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/6925dedf28e6740cd8ad51416ee6fda74d37a7b0956078a89e867b8adb6fc4a1: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/f548ff0b407ff5c8a9f914e7990fc38f420df8e233f72f0f6fa07f636a966765: Cannot mkdir: No such file or directory
tar: ./aufs/mnt: Cannot mkdir: No space left on device
tar: ./aufs/mnt/2357d91e38acae23bafe903c8d3e64ddbe6e6cc5941c425a6d6b1c1ed5782e02: Cannot mkdir: No such file or directory
tar: ./tmp: Cannot mkdir: No space left on device
tar: ./trust: Cannot mkdir: No space left on device
tar: ./containers: Cannot mkdir: No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/requires.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/requires.txt': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/not-zip-safe: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/not-zip-safe': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/top_level.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/top_level.txt': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/entry_points.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/entry_points.txt': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/namespace_packages.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/namespace_packages.txt': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/dependency_links.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/dependency_links.txt': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/SOURCES.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/SOURCES.txt': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg/httpsclient/ssl_peer_verification.py: Cannot create symlink to '/usr/share/pyshared/ndg/httpsclient/ssl_peer_verification.py': No space left on device
tar: ./aufs/diff/d9a967ad2628dddb189252a7f138e7903f3472a0251d5ad6b2f198d74013965d/usr/lib/pymodules/python2.7/ndg/httpsclient/test/scripts/openssl_https_server.sh: Cannot create symlink to '/usr/share/pyshared/ndg/httpsclient/test/scripts/openssl_https_server.sh': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/requires.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/requires.txt': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/not-zip-safe: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/not-zip-safe': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/top_level.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/top_level.txt': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/entry_points.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/entry_points.txt': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/namespace_packages.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/namespace_packages.txt': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/dependency_links.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/dependency_links.txt': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/SOURCES.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/SOURCES.txt': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg/httpsclient/ssl_peer_verification.py: Cannot create symlink to '/usr/share/pyshared/ndg/httpsclient/ssl_peer_verification.py': No space left on device
tar: ./aufs/diff/7a89ed50becebe352d82d18605737b635677907e71b2c7c79c07c90d28884842/usr/lib/pymodules/python2.7/ndg/httpsclient/test/scripts/openssl_https_server.sh: Cannot create symlink to '/usr/share/pyshared/ndg/httpsclient/test/scripts/openssl_https_server.sh': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/requires.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/requires.txt': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/not-zip-safe: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/not-zip-safe': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/top_level.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/top_level.txt': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/entry_points.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/entry_points.txt': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/namespace_packages.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/namespace_packages.txt': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/dependency_links.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/dependency_links.txt': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg_httpsclient-0.3.2.egg-info/SOURCES.txt: Cannot create symlink to '/usr/share/pyshared/ndg_httpsclient-0.3.2.egg-info/SOURCES.txt': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg/httpsclient/ssl_peer_verification.py: Cannot create symlink to '/usr/share/pyshared/ndg/httpsclient/ssl_peer_verification.py': No space left on device
tar: ./aufs/diff/799ea39390ea8f73da9fdc5972e48a58f553ec0e1050884ac4c2d0f2b6b0d9e8/usr/lib/pymodules/python2.7/ndg/httpsclient/test/scripts/openssl_https_server.sh: Cannot create symlink to '/usr/share/pyshared/ndg/httpsclient/test/scripts/openssl_https_server.sh': No space left on device
tar: Exiting with failure status due to previous errors
+ echo SWI=flash:image-20170725.09/.sonic-boot.swi
+ rm -f /tmp/sonic_image.swi
+ sync



+ [ -z 1 ]
+ exit 0


Done
root@sonic:/tmp# df -h
Filesystem      Size  Used Avail Use% Mounted on
root-aufs       1.9G  1.5G  346M  81% /
tmpfs           794M  7.9M  786M   1% /run
/dev/sda1       1.9G  1.5G  346M  81% /host
/dev/loop1       93M  3.8M   83M   5% /var/log
devtmpfs         10M     0   10M   0% /dev
tmpfs           2.0G  984K  2.0G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           2.0G     0  2.0G   0% /sys/fs/cgroup
root@sonic:/tmp# sonic_installer list
Current: SONiC-OS-20170725.08
Next: SONiC-OS-20170725.09
Available: 
SONiC-OS-20170725.09
SONiC-OS-20170725.08