Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

Navigation

Space or DRAM Error During Software Upgrade of a Routing Matrix with a TX Matrix Router

Problem

Note: Throughout this document, we use the term TX Matrix router to refer to the switch-card chassis (SCC) and T640 router to refer to the line-card chassis (LCC).

A routing matrix with a TX Matrix router (scc) and T640 routers (lcc) must have sufficient disk space and DRAM on all Routing Engines for an upgrade of the Junos OS to install successfully. If there is insufficient disk space or DRAM, you might receive a warning indicating that the /var file system is low on free disk space similar to the following:

WARNING: The /var filesystem is low on free disk space.
WARNING: This package requires 1075136k free, but there
WARNING: is only 666502k available.

To determine the amount of free disk space on the Routing Engine, use the CLI show system storage command. To determine the amount of DRAM available on the Routing Engine, use the CLI show chassis routing-engine command.

Below is sample output showing the two commands.

{backup}
user@host-re1> show system storage 
scc-re1:
--------------------------------------------------------------------------
Filesystem              Size       Used      Avail  Capacity   Mounted on
/dev/ad0s1a             217M       176M        24M       88%  /
devfs                   1.0K       1.0K         0B      100%  /dev
devfs                   1.0K       1.0K         0B      100%  /dev/
/dev/md0                 31M        31M         0B      100%  /packages/mnt/jbase
/dev/md1                199M       199M         0B      100%  /packages/mnt/jkernel-9.5R2.1
/dev/md3                4.9M       4.9M         0B      100%  /packages/mnt/jdocs-9.5R2.1
/dev/md4                 55M        55M         0B      100%  /packages/mnt/jroute-9.5R2.1
/dev/md5                 14M        14M         0B      100%  /packages/mnt/jcrypto-9.5R2.1
/dev/md7                2.0G        40K       1.8G        0%  /tmp
/dev/md8                2.0G        11M       1.8G        1%  /mfs
/dev/ad0s1e              24M       1.5M        21M        7%  /config
procfs                  4.0K       4.0K         0B      100%  /proc
/dev/ad1s1f              25G       2.4G        21G       10%  /var
/dev/ad1s1e              24M       1.5M        22M        6%  /tmp/.snp3061/mnt

lcc0-re1:
--------------------------------------------------------------------------
Filesystem              Size       Used      Avail  Capacity   Mounted on
/dev/ad0s1a             220M       186M        16M       92%  /
devfs                   1.0K       1.0K         0B      100%  /dev
devfs                   1.0K       1.0K         0B      100%  /dev/
/dev/md0                 33M        33M         0B      100%  /packages/mnt/jbase
/dev/md1                216M       216M         0B      100%  /packages/mnt/jkernel-9.6B1.8
/dev/md2                 66M        66M         0B      100%  /packages/mnt/jpfe-T-9.6B1.8
/dev/md3                4.1M       4.1M         0B      100%  /packages/mnt/jdocs-9.6B1.8
/dev/md4                 57M        57M         0B      100%  /packages/mnt/jroute-9.6B1.8
/dev/md5                 15M        15M         0B      100%  /packages/mnt/jcrypto-9.6B1.8
/dev/md6                 34M        34M         0B      100%  /packages/mnt/jpfe-common-9.6B1.8
/dev/md7                2.0G      10.0K       1.8G        0%  /tmp
/dev/md8                2.0G       532K       1.8G        0%  /mfs
/dev/ad0s1e              24M        44K        22M        0%  /config               
procfs                  4.0K       4.0K         0B      100%  /proc
/dev/ad2s1f              34G        21G        11G       66%  /var

lcc2-re1:
--------------------------------------------------------------------------
Filesystem              Size       Used      Avail  Capacity   Mounted on
/dev/ad0s1a             217M       178M        21M       89%  /
devfs                   1.0K       1.0K         0B      100%  /dev
devfs                   1.0K       1.0K         0B      100%  /dev/
/dev/md0                 33M        33M         0B      100%  /packages/mnt/jbase
/dev/md1                216M       216M         0B      100%  /packages/mnt/jkernel-9.6B1.8
/dev/md2                 66M        66M         0B      100%  /packages/mnt/jpfe-T-9.6B1.8
/dev/md3                4.1M       4.1M         0B      100%  /packages/mnt/jdocs-9.6B1.8
/dev/md4                 57M        57M         0B      100%  /packages/mnt/jroute-9.6B1.8
/dev/md5                 15M        15M         0B      100%  /packages/mnt/jcrypto-9.6B1.8
/dev/md6                 34M        34M         0B      100%  /packages/mnt/jpfe-common-9.6B1.8
/dev/md7                2.0G       8.0K       1.8G        0%  /tmp
/dev/md8                2.0G       538K       1.8G        0%  /mfs
/dev/ad0s1e              24M        46K        22M        0%  /config
procfs                  4.0K       4.0K         0B      100%  /proc
/dev/ad1s1f              25G       1.3G        22G        5%  /var
{master}
user@host-re0> show chassis routing-engine
scc-re0:
--------------------------------------------------------------------------
Routing Engine status:
  Slot 0:
    Current state                  Master
    Election priority              Master (default)
    Temperature                 41 degrees C / 105 degrees F
    CPU temperature             43 degrees C / 109 degrees F
    DRAM                      2048 MB
    Memory utilization          21 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     4 percent
      Interrupt                  0 percent
      Idle                      96 percent
    Model                          RE-4.0
    Serial ID                      P11123909610
    Start time                     2009-06-16 13:21:12 PDT
    Uptime                         21 hours, 19 minutes, 44 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.03       0.06       0.07
Routing Engine status:
  Slot 1:
    Current state                  Backup
    Election priority              Backup (default)
    Temperature                 39 degrees C / 102 degrees F
    CPU temperature             38 degrees C / 100 degrees F
    DRAM                      2048 MB
    Memory utilization          20 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     0 percent
      Interrupt                  0 percent
      Idle                     100 percent
    Model                          RE-4.0
    Serial ID                      211123900273
    Start time                     2009-06-15 13:38:48 PDT
    Uptime                         1 day, 21 hours, 2 minutes, 5 seconds
    Last reboot reason             Router rebooted after a normal shutdown.

lcc0-re0:
--------------------------------------------------------------------------
Routing Engine status:
  Slot 0:
    Current state                  Master
    Election priority              Master (default)
    Temperature                 46 degrees C / 114 degrees F
    CPU temperature             50 degrees C / 122 degrees F
    DRAM                      2048 MB
    Memory utilization          18 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     2 percent
      Interrupt                  0 percent
      Idle                      98 percent
    Model                          RE-4.0
    Serial ID                      P11123908065
    Start time                     2009-06-16 13:20:59 PDT
    Uptime                         21 hours, 19 minutes, 56 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.05       0.03       0.00
Routing Engine status:
  Slot 1:
    Current state                  Backup
    Election priority              Backup (default)
    Temperature                 50 degrees C / 122 degrees F
    CPU temperature             55 degrees C / 131 degrees F
    DRAM                      3584 MB
    Memory utilization          11 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     0 percent
      Interrupt                  0 percent
      Idle                     100 percent
    Model                          RE-A-2000
    Serial ID                      1000673710
    Start time                     2009-06-15 13:34:44 PDT
    Uptime                         1 day, 21 hours, 6 minutes, 8 seconds
    Last reboot reason             Router rebooted after a normal shutdown.

lcc2-re0:
--------------------------------------------------------------------------
Routing Engine status:
  Slot 0:
    Current state                  Master
    Election priority              Master (default)
    Temperature                 41 degrees C / 105 degrees F
    CPU temperature             42 degrees C / 107 degrees F
    DRAM                      2048 MB
    Memory utilization          18 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     2 percent
      Interrupt                  0 percent
      Idle                      98 percent
    Model                          RE-4.0
    Serial ID                      P11123908326
    Start time                     2009-06-16 13:21:10 PDT
    Uptime                         21 hours, 19 minutes, 44 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.00       0.00       0.00
Routing Engine status:
  Slot 1:
    Current state                  Backup
    Election priority              Backup (default)
    Temperature                 41 degrees C / 105 degrees F
    CPU temperature             42 degrees C / 107 degrees F
    DRAM                      2048 MB
    Memory utilization          18 percent
    CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     0 percent
      Interrupt                  0 percent
      Idle                     100 percent
    Model                          RE-4.0
    Serial ID                      212058900119
    Start time                     2009-06-15 13:37:41 PDT
    Uptime                         1 day, 21 hours, 3 minutes, 8 seconds

Solution

If you find that you need to free up some space, issue the request system storage cleanup command and delete everything that appears in the output. then try the upgrade again.

{master}
user@host-re0> request system storage cleanup 

List of files to delete:

         Size Date         Name
     2B Jun 16 12:46 /var/crash/bounds
  80.4M Jun 15 14:56 /var/crash/cores/kernel.0.090615.1455
  80.4M Jun 15 15:46 /var/crash/cores/kernel.1.090615.1546
  80.4M Jun 15 15:58 /var/crash/cores/kernel.2.090615.1558
  80.4M Jun 16 12:47 /var/crash/cores/kernel.3.090616.1246
  30.6M Jun 15 15:05 /var/crash/cores/vmcore.0.090615.1455.tgz
  33.5M Jun 15 16:33 /var/crash/cores/vmcore.1.090615.1546.tgz
  35.9M Jun 15 17:52 /var/crash/cores/vmcore.2.090615.1558.tgz
  48.0M Jun 16 13:47 /var/crash/cores/vmcore.3.090616.1246.tgz
   504B Jun 15 14:55 /var/crash/info.0
   504B Jun 15 15:46 /var/crash/info.1
   505B Jun 15 15:58 /var/crash/info.2
   505B Jun 16 12:46 /var/crash/info.3
   716B Jun 15 13:43 /var/log/install.0.gz
  1669B Jun 13 18:05 /var/log/install.1.gz
  [...Output Truncated...]
 201.6K Jun 11 02:27 /var/tmp/jnx-routeservice-9.6I20090611_0926_root.tgz
  59.7K Jun 10 09:07 /var/tmp/jnx_ifinfo_sanity.pl.base_test_cfg_66245
  59.9K Jun 10 15:19 /var/tmp/jnx_ifinfo_sanity.pl.base_test_cfg_74023
  59.7K Jun 11 02:57 /var/tmp/jnx_ifinfo_sanity.pl.base_test_cfg_83419
 181.0M Jul 23  2008 /var/tmp/mchassis-install.tgz
  59.7K Jun 10 09:07 /var/tmp/orig_z8_cfg_66245
  59.9K Jun 10 15:19 /var/tmp/orig_z8_cfg_74023
  59.7K Jun 11 02:57 /var/tmp/orig_z8_cfg_83419
Delete these files ? [yes,no] (no) yes

Note: For some DRAM issues, remove any superfluous files from the /root and /tmp directories.

Published: 2012-11-28