Zoneminder 1.36.17 Freezing on Third Camera

[rdbates1]

I'm adding a few cameras to my network and decided to upgrade my old dual core 2.13 2gig server with a quad core 2.67 8gig. The old one was happy to run three cameras and was ok with a couple more. The new one is running Ubuntu 20 and runs great on two cameras with a load of around 1.3. As soon as I add a third camera, load spikes to 20 and the system becomes unusable. I can't even start a ssh session. They only way to recover is a hard reboot. Checking the memory usage just now with two cameras it's setting at 91%. The configuration is identical to the old server.

Jun 14 10:51:59 zm3 systemd[1]: Finished Ubuntu Advantage Timer for running repeated jobs.
Jun 14 10:52:51 zm3 zmc_m6[5786]: ERR [zmc_m6] [Can't mkdir /mnt/mnt126/6: Permission denied]
Jun 14 10:52:53 zm3 zmc_m6[5786]: WAR [zmc_m6] [Monitor dimensions are 640x480 but camera is sending 2592x1944]
Jun 14 10:52:54 zm3 zmc_m6[5786]: ERR [zmc_m6] [Can't mkdir /mnt/mnt126/6: Permission denied]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [Failed creating event dir at /mnt/mnt126]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [non increasing dts, fixing. our dts -30000 stream 0 last_dts 0]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [pkt.dts(0) must be <= pkt.pts(-30000).Decompression must happen before presentation.]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [non increasing dts, fixing. our dts -24000 stream 0 last_dts 0]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [pkt.dts(0) must be <= pkt.pts(-24000).Decompression must happen before presentation.]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [non increasing dts, fixing. our dts -18000 stream 0 last_dts 0]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [pkt.dts(0) must be <= pkt.pts(-18000).Decompression must happen before presentation.]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [non increasing dts, fixing. our dts -12000 stream 0 last_dts 0]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [pkt.dts(0) must be <= pkt.pts(-12000).Decompression must happen before presentation.]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [non increasing dts, fixing. our dts -6000 stream 0 last_dts 0]
Jun 14 10:52:54 zm3 zmc_m6[5786]: WAR [zmc_m6] [pkt.dts(0) must be <= pkt.pts(-6000).Decompression must happen before presentation.]
Jun 14 10:55:30 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 135 seconds behind capture.]
Jun 14 10:55:32 zm3 kernel: [ 766.388466] 8139too 0000:06:04.0 enp6s4: link down
Jun 14 10:55:34 zm3 systemd-networkd[767]: enp6s4: Lost carrier
Jun 14 10:55:35 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 142 seconds behind capture.]
Jun 14 10:55:35 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 142 seconds behind capture.]
Jun 14 10:55:39 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 146 seconds behind capture.]
Jun 14 10:55:44 zm3 systemd[1]: Started Session 3 of user root.
Jun 14 10:55:46 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 153 seconds behind capture.]
Jun 14 10:55:46 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 153 seconds behind capture.]
Jun 14 10:55:47 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 154 seconds behind capture.]
Jun 14 10:55:47 zm3 zmc_m1[3170]: message repeated 14 times: [ WAR [zmc_m1] [Decoding is not keeping up. We are 154 seconds behind capture.]]
Jun 14 10:55:47 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 153 seconds behind capture.]
Jun 14 10:55:47 zm3 zmc_m1[3170]: message repeated 22 times: [ WAR [zmc_m1] [Decoding is not keeping up. We are 153 seconds behind capture.]]
Jun 14 10:55:48 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 154 seconds behind capture.]
Jun 14 10:55:48 zm3 zmc_m1[3170]: message repeated 9 times: [ WAR [zmc_m1] [Decoding is not keeping up. We are 154 seconds behind capture.]]
Jun 14 10:55:50 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 156 seconds behind capture.]
Jun 14 10:55:52 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 158 seconds behind capture.]
Jun 14 10:55:53 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 159 seconds behind capture.]
Jun 14 10:55:53 zm3 zmc_m1[3170]: message repeated 2 times: [ WAR [zmc_m1] [Decoding is not keeping up. We are 159 seconds behind capture.]]
Jun 14 10:55:54 zm3 zmc_m6[5786]: ERR [zmc_m6] [Failed to capture image from monitor 6 Monitor-4 (1/1)]
Jun 14 10:55:54 zm3 zmc_m1[3170]: ERR [zmc_m1] [Failed to capture image from monitor 1 Living Room (1/1)]
Jun 14 10:55:54 zm3 zmc_m4[3204]: ERR [zmc_m4] [Failed to capture image from monitor 4 Bedroom (1/1)]
Jun 14 10:55:55 zm3 zmc_m1[3170]: WAR [zmc_m1] [Decoding is not keeping up. We are 161 seconds behind capture.]
Jun 14 10:55:59 zm3 zmwatch[1233]: WAR [Restarting capture daemon for Bedroom, time since last capture 132 seconds (1655229356-1655229224)]
Jun 14 10:56:02 zm3 zmc_m4[3204]: WAR [zmc_m4] [Decoding is not keeping up. We are 138 seconds behind capture.]
Jun 14 10:56:08 zm3 zmc_m6[5786]: ERR [zmc_m6] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:56:11 zm3 zmc_m4[3204]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Interrupted system call]
Jun 14 10:56:11 zm3 zmc_m4[3204]: ERR [zmc_m4] [Failed to prime capture of initial monitor]
Jun 14 10:56:11 zm3 zmc_m6[5786]: ERR [zmc_m6] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Interrupted system call]
Jun 14 10:56:11 zm3 zmc_m6[5786]: ERR [zmc_m6] [Failed to prime capture of initial monitor]
Jun 14 10:56:13 zm3 kernel: [ 807.443048] perf: interrupt took too long (2626 > 2500), lowering kernel.perf_event_max_sample_rate to 76000
Jun 14 10:56:21 zm3 zmwatch[1233]: ERR [Memory map file '/dev/shm/zm.mmap.4' does not exist in zmMemAttach. zmc might not be running.]
Jun 14 10:56:23 zm3 zmc_m1[3170]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:56:23 zm3 zmc_m1[3170]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:56:29 zm3 zmc_m4[5979]: ERR [zmc_m4] [Can't mkdir /mnt/mnt126/4: Permission denied]
Jun 14 10:56:35 zm3 zmc_m1[3170]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:56:35 zm3 zmc_m1[3170]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:56:41 zm3 zmc_m4[5979]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:56:48 zm3 zmc_m1[3170]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:56:48 zm3 zmc_m1[3170]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:56:53 zm3 zmc_m4[5979]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:56:53 zm3 zmc_m4[5979]: ERR [zmc_m4] [Failed to prime capture of initial monitor]
Jun 14 10:57:02 zm3 zmc_m1[3170]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:57:02 zm3 zmc_m1[3170]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:57:02 zm3 zmwatch[1233]: WAR [Restarting capture daemon for Living Room, no image since startup. Startup time was 1655229372 - now 1655229422 > 45]
Jun 14 10:57:03 zm3 PackageKit: daemon quit
Jun 14 10:57:03 zm3 systemd[1]: packagekit.service: Succeeded.
Jun 14 10:57:03 zm3 zmc_m1[3170]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:57:03 zm3 zmc_m1[3170]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:57:06 zm3 zmc_m4[5979]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:57:06 zm3 zmc_m4[5979]: ERR [zmc_m4] [Failed to prime capture of initial monitor]
Jun 14 10:57:06 zm3 zmc_m1[5996]: ERR [zmc_m1] [Can't mkdir /mnt/mnt126/1: Permission denied]
Jun 14 10:57:09 zm3 systemd[1]: Stopping ZoneMinder CCTV recording and surveillance system...
Jun 14 10:57:12 zm3 zmc_m4[5979]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Interrupted system call]
Jun 14 10:57:12 zm3 zmc_m4[5979]: ERR [zmc_m4] [Failed to prime capture of initial monitor]
Jun 14 10:57:13 zm3 zmc_m1[5996]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Interrupted system call]
Jun 14 10:57:23 zm3 zmdc[1169]: WAR ['zmfilter.pl --filter_id=2 --daemon' has not stopped at 22/06/14 10:57:23 after 10 seconds. Sending KILL to pid 1227]
Jun 14 10:57:24 zm3 zmdc[1169]: WAR ['zmstats.pl' has not stopped at 22/06/14 10:57:24 after 10 seconds. Sending KILL to pid 1244]
Jun 14 10:57:24 zm3 zmdc[1169]: WAR ['zmwatch.pl' has not stopped at 22/06/14 10:57:24 after 10 seconds. Sending KILL to pid 1233]
Jun 14 10:57:24 zm3 zmdc[1169]: WAR ['zmfilter.pl --filter_id=1 --daemon' has not stopped at 22/06/14 10:57:24 after 10 seconds. Sending KILL to pid 1222]
Jun 14 10:57:26 zm3 systemd[1]: zoneminder.service: Succeeded.
Jun 14 10:57:26 zm3 systemd[1]: Stopped ZoneMinder CCTV recording and surveillance system.
Jun 14 10:57:45 zm3 systemd[1]: Starting ZoneMinder CCTV recording and surveillance system...
Jun 14 10:57:46 zm3 systemd[1]: Starting Cleanup of Temporary Directories...
Jun 14 10:57:46 zm3 systemd[1]: systemd-tmpfiles-clean.service: Succeeded.
Jun 14 10:57:46 zm3 systemd[1]: Finished Cleanup of Temporary Directories.
Jun 14 10:57:48 zm3 zmc_m1[6101]: ERR [zmc_m1] [Can't mkdir /mnt/mnt126/1: Permission denied]
Jun 14 10:57:48 zm3 zmc_m4[6106]: ERR [zmc_m4] [Can't mkdir /mnt/mnt126/4: Permission denied]
Jun 14 10:57:51 zm3 systemd[1]: Started ZoneMinder CCTV recording and surveillance system.
Jun 14 10:57:59 zm3 zmc_m1[6101]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:58:00 zm3 zmc_m4[6106]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:58:08 zm3 zmc_m4[6106]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: No route to host]
Jun 14 10:58:08 zm3 zmc_m4[6106]: ERR [zmc_m4] [Failed to prime capture of initial monitor]
Jun 14 10:58:11 zm3 zmc_m1[6101]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:58:11 zm3 zmc_m1[6101]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:58:15 zm3 kernel: [ 929.026292] 8139too 0000:06:04.0 enp6s4: link up, 100Mbps, full-duplex, lpa 0x45E1
Jun 14 10:58:15 zm3 systemd-networkd[767]: enp6s4: Gained carrier
Jun 14 10:58:21 zm3 zmc_m4[6106]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:58:21 zm3 zmc_m4[6106]: ERR [zmc_m4] [Failed to prime capture of initial monitor]
Jun 14 10:58:24 zm3 zmc_m1[6101]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:58:24 zm3 zmc_m1[6101]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:58:35 zm3 zmc_m4[6106]: ERR [zmc_m4] [Unable to open input rtsp://192.168.25.21:554/user=admin_password=tlJwpbo6_channel=1_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:58:35 zm3 zmc_m4[6106]: ERR [zmc_m4] [Failed to prime capture of initial monitor]
Jun 14 10:58:38 zm3 zmc_m1[6101]: ERR [zmc_m1] [Unable to open input rtsp://:@192.168.25.20:554/user=admin_password=tlJwpbo6_channel=0_stream=0.sdp?real_stream due to: Immediate exit requested]
Jun 14 10:58:38 zm3 zmc_m1[6101]: ERR [zmc_m1] [Failed to prime capture of initial monitor]
Jun 14 10:58:40 zm3 zmwatch[6121]: WAR [Restarting capture daemon for Living Room, no image since startup. Startup time was 1655229468 - now 1655229520 > 45]

[bbunge]

Lower the camera resolution. 720P or lower. Lower the frame rate to 10 or lower at the camera. Run mysqltuner to make adjustments to the database settings (innodb_buffer_pool_size may need to be increased).

[dougmccrary]

Permissions?

Code: Select all

Jun 14 10:52:51 zm3 zmc_m6[5786]: ERR [zmc_m6] [Can't mkdir /mnt/mnt126/6: Permission denied]