Junos
Highlighted
Junos

Folder /var/rundb full. No commit possible

[ Edited ]
‎01-15-2019 03:54 AM

Hi There,

 

I can not commit anymore on the following device

Model: ex3200-48t
JUNOS Base OS boot [11.4R5.7]
JUNOS Base OS Software Suite [11.4R5.7]
JUNOS Kernel Software Suite [11.4R5.7]
JUNOS Crypto Software Suite [11.4R5.7]
JUNOS Online Documentation [11.4R5.7]
JUNOS Enterprise Software Suite [11.4R5.7]
JUNOS Packet Forwarding Engine Enterprise Software Suite [11.4R5.7]
JUNOS Routing Software Suite [11.4R5.7]
JUNOS Web Management [11.4R5.7]
JUNOS FIPS mode utilities [11.4R5.7]

 

Reason:

Switch# commit confirmed 1
error: could not copy to juniper.save+

 

Investigation:

show system storage | match rundb
/dev/md10 59M 51M 2.9M 95% /var/rundb

Content of the folder

/var/rundb/:
total 105140
-rw-r----- 1 root config 0 May 18 2015 .db_lock
drwxrwxr-x 2 root operator 512 May 18 2015 .snap/
-rw-r--r-- 1 root config 1048576 May 18 2015 chassisd.dynamic.db
-rw-r----- 1 root config 11010048 Jan 11 06:55 juniper.data
-rw-r----- 1 root config 12058624 Jan 15 11:30 juniper.data+
-rw-r----- 1 root config 12058624 Jan 15 11:30 juniper.db
-rw-r----- 1 root config 2097152 May 18 2015 juniper.dyn
-rw-r----- 1 root config 11010048 Jan 11 06:55 juniper.save
drwxr-xr-x 2 root config 512 May 18 2015 private/
-rw-r----- 1 root config 15204352 May 18 2015 schema.db
drwxr-xr-x 2 root config 512 May 18 2015 sdb/

 

Question:

Any hint on how can I get this solved?

Which optimization may I do in order to decrease the size of the file juniper.save?

Thank you.

6 REPLIES 6
Highlighted
Junos

Re: Folder /var/rundb full. No commit possible

‎01-15-2019 03:59 AM

start by doing a 'request system storage cleanup'. That should help. If not, please provide updated output from 'show system storage' and content of /var/rundb


--
Best regards,

Jonas Hauge Klingenberg
Juniper Ambassador & Technology Architect, SEC DATACOM A/S (Denmark)
Highlighted
Junos

Re: Folder /var/rundb full. No commit possible

‎01-15-2019 04:20 AM

Hi,

request system storage cleanup  was already in my mind but did not help. The files deleted with this command have nohting to do with files contained in the folder rundb

 

request system storage cleanup

List of files to delete:

Size Date Name
11B Aug 24 19:14 /var/jail/tmp/alarmd.ts
130B Jan 15 11:44 /var/log/default-log-messages.0.gz
118B Jan 15 11:44 /var/log/firewall.0.gz
366B Nov 14 2012 /var/log/install.0.gz
5897B Jan 15 11:44 /var/log/interactive-commands.0.gz
7834B Jan 15 10:45 /var/log/interactive-commands.1.gz
7404B Jan 15 08:45 /var/log/interactive-commands.2.gz
7299B Jan 15 07:00 /var/log/interactive-commands.3.gz
7277B Jan 15 05:30 /var/log/interactive-commands.4.gz
7260B Jan 15 04:00 /var/log/interactive-commands.5.gz
7937B Jan 15 02:30 /var/log/interactive-commands.6.gz
7059B Jan 15 00:30 /var/log/interactive-commands.7.gz
7035B Jan 14 22:45 /var/log/interactive-commands.8.gz
7743B Jan 14 21:15 /var/log/interactive-commands.9.gz
3039B Jan 15 11:44 /var/log/messages.0.gz
8189B Jan 15 09:30 /var/log/messages.1.gz
8583B Jan 15 02:00 /var/log/messages.2.gz
8816B Jan 14 10:30 /var/log/messages.3.gz
10.6K Jan 12 16:45 /var/log/messages.4.gz
10.8K Jan 2 01:15 /var/log/messages.5.gz
11.5K Dec 16 11:15 /var/log/messages.6.gz
12.0K Nov 30 08:15 /var/log/messages.7.gz
11.7K Nov 16 12:30 /var/log/messages.8.gz
11.5K Nov 8 12:15 /var/log/messages.9.gz
207B Jan 15 10:20 /var/log/wtmp.0.gz
27B Dec 19 07:30 /var/log/wtmp.1.gz
27B Dec 9 08:00 /var/log/wtmp.2.gz
27B Nov 19 08:00 /var/log/wtmp.3.gz
27B Nov 9 08:30 /var/log/wtmp.4.gz
124.0K Jan 5 2013 /var/tmp/gres-tp/env.dat
0B Jan 5 2013 /var/tmp/gres-tp/lock
155B May 18 2015 /var/tmp/krt_gencfg_filter.txt
0B May 18 2015 /var/tmp/rtsdb/if-rtsdb
Delete these files ? [yes,no] (no)

 

More

Content of rundb folder

 

file list /var/rundb/ detail

/var/rundb/:
total 105140
-rw-r----- 1 root config 0 May 18 2015 .db_lock
drwxrwxr-x 2 root operator 512 May 18 2015 .snap/
-rw-r--r-- 1 root config 1048576 May 18 2015 chassisd.dynamic.db
-rw-r----- 1 root config 11010048 Jan 11 06:55 juniper.data
-rw-r----- 1 root config 12058624 Jan 15 11:30 juniper.data+
-rw-r----- 1 root config 12058624 Jan 15 11:30 juniper.db
-rw-r----- 1 root config 2097152 May 18 2015 juniper.dyn
-rw-r----- 1 root config 11010048 Jan 11 06:55 juniper.save
drwxr-xr-x 2 root config 512 May 18 2015 private/
-rw-r----- 1 root config 15204352 May 18 2015 schema.db
drwxr-xr-x 2 root config 512 May 18 2015 sdb/

 

show system storage

show system storage
Filesystem Size Used Avail Capacity Mounted on
/dev/da0s1a 183M 100M 68M 60% /
devfs 1.0K 1.0K 0B 100% /dev
/dev/md0 35M 35M 0B 100% /packages/mnt/jbase
/dev/md1 1.4M 1.4M 0B 100% /packages/mnt/fips-mode-powerpc-11.4R5.7
/dev/md2 11M 11M 0B 100% /packages/mnt/jcrypto-ex-11.4R5.7
/dev/md3 5.3M 5.3M 0B 100% /packages/mnt/jdocs-ex-11.4R5.7
/dev/md4 79M 79M 0B 100% /packages/mnt/jkernel-ex-11.4R5.7
/dev/md5 19M 19M 0B 100% /packages/mnt/jpfe-ex42x-11.4R5.7
/dev/md6 30M 30M 0B 100% /packages/mnt/jroute-ex-11.4R5.7
/dev/md7 14M 14M 0B 100% /packages/mnt/jswitch-ex-11.4R5.7
/dev/md8 20M 20M 0B 100% /packages/mnt/jweb-ex-11.4R5.7
/dev/md9 126M 12K 116M 0% /tmp
/dev/da0s3e 123M 1.8M 111M 2% /var
/dev/da0s3d 369M 22K 339M 0% /var/tmp
/dev/da0s4d 62M 1.8M 55M 3% /config
/dev/md10 59M 51M 2.9M 95% /var/rundb
procfs 4.0K 4.0K 0B 100% /proc
/var/jail/etc 123M 1.8M 111M 2% /packages/mnt/jweb-ex-11.4R5.7/jail/var/etc
/var/jail/run 123M 1.8M 111M 2% /packages/mnt/jweb-ex-11.4R5.7/jail/var/run
/var/jail/tmp 123M 1.8M 111M 2% /packages/mnt/jweb-ex-11.4R5.7/jail/var/tmp
/var/tmp 369M 22K 339M 0% /packages/mnt/jweb-ex-11.4R5.7/jail/var/tmp/uploads
devfs 1.0K 1.0K 0B 100% /packages/mnt/jweb-ex-11.4R5.7/jail/dev

Highlighted
Junos

Re: Folder /var/rundb full. No commit possible

‎05-22-2019 12:08 PM

Any solution to this? I'm bumping up against a similar problem.

Highlighted
Junos

Re: Folder /var/rundb full. No commit possible

‎05-22-2019 12:57 PM

Hi Zimage,

 

The /var/rundb folder contains various runtime objects /databases which are important for functioning of the device and hence it is not possible to provide a solution with available info.

To better understand the issue, please collect the following information and open a JTAC case:

From Shell mode:

ls -Rl /var/rundb
ls -Rl /var/rundb/sdb
cd /var/rundb
df –k
du -cks * | sort –rn
cd /var/rundb/sdb
du -cks * | sort –rn

 

 

From CLI:

show configuration | display inheritance | display set | no-more

 

- Since when did you start seeing this error ? Was there any changes made after which this error started appearing ?

- Also any reason for sticking on to 11.4 Junos code ?

 

Thanks,

Kinshuk

 

Highlighted
Junos

Re: Folder /var/rundb full. No commit possible

‎05-22-2019 01:54 PM

Hi Fab,

 

The  "show system storage" shows that /var/rundb is almost full. Cleanup command will not delete files from /var/rundb since it only lists the files which are safe to delete.  I would suggest to open a JTAC ticket to check the best solution possible with the available data.  

 

Regards,

Rahul Gautam

Highlighted
Junos

Re: Folder /var/rundb full. No commit possible

‎06-05-2019 05:41 AM

Good Day,

 

You could try to follow next steps to clear this issue:

root@switch%cd /var/rundb/
root@switch%rm juniper.*
root@switch%mgd -I

 

Feedback