"Discarding frame" and "Packet in sequence, gap N" floods the log
Posted: Tue Nov 29, 2016 11:30 am
Hello guys!
Recently these warning have started appearing in ZM log:
...and so on. CPU load goes up to 2.00 and even beyond. Shorterly after this, ZM service may crash and won't restart (but may not, somehow). After restarting, it can happen again after 1-5 mins. Of course, there are no events recorded at this period. Crash log:
I'm running ZoneMinder 1.29.0 on Debian Wheezy, installed on Core2duo E8400 with DDRII 2 GB. Now, I have only one monitor - IP-camera (Beward BD4070) connect to LAN, which providing H264 720p25 video over RTP. I should say that problem started when I've raised bitrate in camera: from 4 Mbit/s to 8 Mbit/s. I wanted to get the maximum picture quality I could. Today, I've decreased it back to 4 Mbit/s, problem has gone but not completely. I've still have similar records in log:
They appear at different frequency and don't crash zmc daemon. Events are recorded.
I have only one question: what "Packet in sequence, gap N" and "Discarding partial, incomplete etc. frame" means? Why does it happen on a higher bitrate and even crashes zmc? I see a hard CPU overload but there is no out-of-memory, according to top or df -h /dev/shm. Is it ZM can not get in time nad handle all incoming frames? Network problem? But I've already sniffed and examined it, there are no retransmissions or packet loss. I've searched the Internet and this forum for this problem, but all topics are left unanswered. Can you at least give a clue, where to dig the problem? I'm a bit new to Zoneminder, however I've already loved it and don't want something other...
And here's my settings:
Recently these warning have started appearing in ZM log:
Code: Select all
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 68]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 26]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 69]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 50]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding incomplete frame 10684, 0 bytes]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 63]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding partial frame 10684, 8608 bytes]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 60]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 58]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 75]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:38 server zmc[24856]: WAR [Packet in sequence, gap 75]
Nov 29 06:04:38 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding incomplete frame 10684, 0 bytes]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 46]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding partial frame 10684, 24382 bytes]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 39]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 87]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 62]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 64]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 25]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 62]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 51]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 61]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 63]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:39 server zmc[24856]: WAR [Packet in sequence, gap 86]
Nov 29 06:04:39 server zmc[24856]: WAR [Discarding frame 10684]
Nov 29 06:04:40 server zmc[24856]: WAR [Packet in sequence, gap 40]
Nov 29 06:04:40 server zmc[24856]: WAR [Discarding frame 10684]
Code: Select all
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 59]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 58]
Nov 29 06:18:59 server zmwatch[21640]: INF [Restarting capture daemon for Beward, time since last capture 6 seconds (1480389539-1480389533)]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 63]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmdc[21580]: INF ['zmc -m 1' sending stop to pid 24921 at 16/11/29 06:18:59]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 65]
Nov 29 06:18:59 server zmc[24921]: INF [Got signal 15 (Terminated), exiting]
Nov 29 06:18:59 server zmc[24921]: ERR [Can't insert log entry: Lost connection to MySQL server during query]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 53]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 71]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 31]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 69]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding incomplete frame 22217, 0 bytes]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 65]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding partial frame 22217, 1438 bytes]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 31]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 60]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 65]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 84]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding incomplete frame 22217, 0 bytes]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 64]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding partial frame 22217, 8608 bytes]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 93]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Packet in sequence, gap 105]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding frame 22217]
Nov 29 06:18:59 server zmc[24921]: WAR [Discarding incomplete frame 22217, 0 bytes]
Nov 29 06:19:05 server zmdc[21580]: WAR ['zmc -m 1' has not stopped at 16/11/29 06:19:05. Sending KILL to pid 24921]
Nov 29 06:19:05 server zmdc[21580]: INF ['zmc -m 1' crashed, signal 8]
Nov 29 06:19:05 server zmdc[21580]: INF [Starting pending process, zmc -m 1]
Nov 29 06:19:05 server zmdc[25072]: INF ['zmc -m 1' started at 16/11/29 06:19:05]
Nov 29 06:19:05 server zmdc[21580]: INF ['zmc -m 1' starting at 16/11/29 06:19:05, pid = 25072]
Nov 29 06:19:05 server zmc[25072]: INF [Starting Capture version 1.29.0]
Nov 29 06:19:48 server zma[21874]: INF [Beward: 342000 - Analysing at 18.18 fps]
Nov 29 06:19:48 server zmc[25072]: INF [Beward: 1000 - Capturing at 23.26 fps]
Nov 29 06:20:28 server zma[21874]: INF [Beward: 343000 - Analysing at 25.00 fps]
Code: Select all
Nov 29 14:00:59 server zma[30165]: INF [Beward: 170000 - Analysing at 25.00 fps]
Nov 29 14:01:18 server zmc[30542]: INF [Beward: 149000 - Capturing at 25.00 fps]
Nov 29 14:01:39 server zma[30165]: INF [Beward: 171000 - Analysing at 25.00 fps]
Nov 29 14:01:58 server zmc[30542]: INF [Beward: 150000 - Capturing at 25.00 fps]
Nov 29 14:02:19 server zma[30165]: INF [Beward: 172000 - Analysing at 25.00 fps]
Nov 29 14:02:39 server zmc[30542]: INF [Beward: 151000 - Capturing at 25.00 fps]
Nov 29 14:02:39 server zmc[30542]: WAR [Packet in sequence, gap 19]
Nov 29 14:02:39 server zmc[30542]: WAR [Discarding partial frame 161099, 22948 bytes]
Nov 29 14:02:39 server zmc[30542]: WAR [Discarding incomplete frame 161099, 0 bytes]
Nov 29 14:02:59 server zma[30165]: INF [Beward: 173000 - Analysing at 25.00 fps]
Nov 29 14:03:19 server zmc[30542]: INF [Beward: 152000 - Capturing at 25.00 fps]
Nov 29 14:03:19 server zmc[30542]: WAR [Packet in sequence, gap 56]
Nov 29 14:03:19 server zmc[30542]: WAR [Discarding partial frame 162166, 18646 bytes]
Nov 29 14:03:19 server zmc[30542]: WAR [Discarding incomplete frame 162166, 0 bytes]
Nov 29 14:03:40 server zma[30165]: INF [Beward: 174000 - Analysing at 25.00 fps]
Nov 29 14:03:59 server zmc[30542]: INF [Beward: 153000 - Capturing at 24.39 fps]
Nov 29 14:03:59 server zmc[30542]: WAR [Packet in sequence, gap 19]
Nov 29 14:03:59 server zmc[30542]: WAR [Discarding partial frame 163233, 22948 bytes]
Nov 29 14:03:59 server zmc[30542]: WAR [Discarding incomplete frame 163233, 0 bytes]
Nov 29 14:04:20 server zma[30165]: INF [Beward: 175000 - Analysing at 24.39 fps]
Nov 29 14:04:39 server zmc[30542]: INF [Beward: 154000 - Capturing at 25.00 fps]
Nov 29 14:04:39 server zmc[30542]: WAR [Packet in sequence, gap 39]
Nov 29 14:04:39 server zmc[30542]: WAR [Discarding partial frame 164300, 43024 bytes]
Nov 29 14:04:39 server zmc[30542]: WAR [Discarding incomplete frame 164300, 0 bytes]
Nov 29 14:05:00 server zma[30165]: INF [Beward: 176000 - Analysing at 25.00 fps]
Nov 29 14:05:19 server zmc[30542]: INF [Beward: 155000 - Capturing at 25.00 fps]
I have only one question: what "Packet in sequence, gap N" and "Discarding partial, incomplete etc. frame" means? Why does it happen on a higher bitrate and even crashes zmc? I see a hard CPU overload but there is no out-of-memory, according to top or df -h /dev/shm. Is it ZM can not get in time nad handle all incoming frames? Network problem? But I've already sniffed and examined it, there are no retransmissions or packet loss. I've searched the Internet and this forum for this problem, but all topics are left unanswered. Can you at least give a clue, where to dig the problem? I'm a bit new to Zoneminder, however I've already loved it and don't want something other...
And here's my settings: