5.25. Partitions running out of space

There are several partitions on the Steelhead appliance which are writable and can run out of space:

When a partition is full, an alarm will be raised and the status of the device will become Degraded:

Figure 5.190. File system alarm

[statsd.NOTICE]: Alarm triggered for rising error for event fs_mnt

The command support show disk shows the status of the partitions:

Figure 5.191. Output of the command "support show disk"

SH # support show disk
Filesystem         1024-blocks      Used Available Capacity Mounted on
/dev/sdb7               418806     49904    347277      13% /config
/dev/sda3             16513448   2769100  12905408      18% /var
/dev/disk0p6          56765020  39510668  14370736      74% /proxy

The capacity shows the amount of usage which is used: 0% is empty, 100% is full.

5.25.1. The /config partition is full

The /config partition is not manageable from the GUI or CLI and Riverbed TAC should be contacted to determine the cause and resolve the issue.

5.25.2. The /proxy partition is full

The /proxy partition is used by both PFS and RSP.

If PFS is used and the partition is full, then the amount of data stored on the file server backed by the PFS share has exceeded the threshold.

If RSP is used there are several scenarios:

  • Check if there are any RSP images, the RSP software or RSP backups which can be removed.

    Figure 5.192. Removing an obsolete RSP image

    SH # show rsp images
    image_rbt_rsp_6_0_0_n19.img
    image_rbt_rsp_6_5_0_n77.img
    SH # rsp image delete image_rbt_rsp_6_0_0_n19.img
    SH #
    

  • Check if there are any RSP packages, the virtual machines, which can be removed.

    Figure 5.193. Removing an obsolete RSP package

    SH # show rsp packages
    FCI_WIN2K3_STD_X32_v3.0.pkg
    FCI_WIN2K3_STD_X32_v3.1.pkg
    SH # rsp package delete FCI_WIN2K3_STD_X32_v3.0.pkg
    SH #
    


  • Check if there are any RSP backups which can be removed.

    Figure 5.194. Removing an obsolete RSP backup

    SH # show rsp backups
    backup-slot3-20120801.tgz
    backup-slot3-20120802.tgz
    SH # rsp backups delete backup-slot3-20120801.tgz
    SH #
    


5.25.3. The /var partition is full

The /var partition is used for the logging of services running on the Steelhead appliance, to capture historical statistics of various parts of the Steelhead appliance, to store process dumps, system dumps and tcpdump captures and to keep track of process files.

Check the following things:

  • Are there any tcpdump captures running? The background tcpdump capture files are not showing up in the GUI under Reports -> Diagnostics -> TCP Dumps but they still use the disk space:

    Figure 5.195. Check for running background tcpdump captures

    SH # show tcpdump-x
    Name: ssh-cifs
    Start Time: 10:48:17
    
    SH # tcpdump-x capture-name ssh-cifs stop
    SH #
    

  • Are there any tcpdump capture files which can be removed?

    Figure 5.196. Remove obsolete tcpdump capture files

    SH # show files tcpdump
    SH_primary_csh-cifs.cap
    SH_lan0_0_csh-cifs.cap
    SH_wan0_0_csh-cifs.cap
    SH # file tcpdump delete SH_primary_csh-cifs.cap
    SH #
    


  • Are there any old process dumps which can be removed?

    Figure 5.197. Remove obsolete process dumps

    SH # show files process-dump
    sysdump-SH-20120801-200301.tgz
    sysdump-SH-20120801-200523.tgz
    SH # file process-dump delete sysdump-SH-20120801-200301.tgz
    SH #
    


  • Are there any old system dumps which can be removed?

    Figure 5.198. Remove obsolete system dumps

    SH # show files debug-dump
    SH-sport-20120801-200257.tar.gz
    SH-sport-20120801-200519.tar.gz
    SH # file debug-dump delete SH-sport-20120801-200257.tar.gz
    SH #
    


  • Neural framing statistics logs can be gathered but are never rotated. In the sysinfo.txt they can be found under the Output of 'find /var/opt ( -name .running -prune ) -o -type f -ls -mount': section as /var/opt/rbt/neural-stats. Contact the Riverbed TAC to remove them.

    Figure 5.199. Neural Framing log files

    Output of 'find /var/opt ( -name .running -prune ) -o -type f -ls -mount':
    [...]
    634172  564 ---S-wS--T  1 admin  root  72586 Nov  2  2007 /var/opt/rbt/neural-stats.22416. \
        0
    634215   80 ---S-wS--T  1 admin  root  77441 Nov  2  2007 /var/opt/rbt/neural-stats.22416. \
        1
    634216  116 ---S-wS--T  1 admin  root  11986 Nov  2  2007 /var/opt/rbt/neural-stats.22416. \
        2
    634217 2312 ---S-wS--T  1 admin  root  60701 Nov  2  2007 /var/opt/rbt/neural-stats.22416. \
        3
    [...]
    640388   88 -rw-rws---  1 admin  root  84021 Jul 31  2008 /var/opt/rbt/neural-stats.6631.1 \
        159
    640389  144 -rw-rws---  1 admin  root  40656 Jul 31  2008 /var/opt/rbt/neural-stats.6631.1 \
        160
    640390   96 -rw-rws---  1 admin  root  92481 Jul 31  2008 /var/opt/rbt/neural-stats.6631.1 \
        161
    

If the issue isn't resolved after this, please contact Riverbed TAC for further investigation.