rtsp_server crashing

[EK701]

Zoneminder 1.37.50 on Ubuntu 22. I have 4 cameras with RTSP Server checked. They work, but I'm having intermittent crashes of rtsp_server. rtsp_server is crashing with a "Signal 6". Here is the log with more details on the crash/Signal 6:

Code: Select all

02/12/24 18:42:48.083825 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/2532 [Loading Monitors with SELECT `Id`, `Name`, `Deleted`, `ServerId`, `StorageId`, `Type`, `Capturing`+0, `Analysing`+0, `AnalysisSource`+0, `AnalysisImage`+0, `Recording`+0, `RecordingSource`+0, `Decoding`+0, `RTSP2WebEnabled`, `RTSP2WebType`, `JanusEnabled`, `JanusAudioEnabled`, `Janus_Profile_Override`, `Janus_Use_RTSP_Restream`, `Janus_RTSP_User`, `Janus_RTSP_Session_Timeout`, `LinkedMonitors`, `EventStartCommand`, `EventEndCommand`, `AnalysisFPSLimit`,`AnalysisUpdateDelay`, `MaxFPS`, `AlarmMaxFPS`,`Device`, `Channel`, `Format`, `V4LMultiBuffer`, `V4LCapturesPerFrame`, `Protocol`, `Method`, `Options`, `User`, `Pass`, `Host`, `Port`, `Path`, `SecondPath`, `Width`, `Height`, `Colours`, `Palette`, `Orientation`+0, `Deinterlacing`, `Decoder`, `DecoderHWAccelName`, `DecoderHWAccelDevice`, `RTSPDescribe`, `SaveJPEGs`, `VideoWriter`, `EncoderParameters`, `OutputCodec`, `Encoder`, `OutputContainer`, `RecordAudio`, `Brightness`, `Contrast`, `Hue`, `Colour`, `EventPrefix`, `LabelFormat`, `LabelX`, `LabelY`, `LabelSize`,`ImageBufferCount`, `MaxImageBufferCount`, `WarmupCount`, `PreEventCount`, `PostEventCount`, `StreamReplayBuffer`, `AlarmFrameCount`, `SectionLength`, `SectionLengthWarn`, `MinSectionLength`, `FrameSkip`,`MotionFrameSkip`, `FPSReportInterval`, `RefBlendPerc`, `AlarmRefBlendPerc`, `TrackMotion`, `Exif`, `Latitude`, `Longitude`, `RTSPServer`, `RTSPStreamName`, `ONVIF_Alarm_Text`,`ONVIF_URL`, `ONVIF_Username`, `ONVIF_Password`, `ONVIF_Options`, `ONVIF_Event_Listener`, `use_Amcrest_API`,`SignalCheckPoints`, `SignalCheckColour`, `Importance`-1, ZoneCount  FROM `Monitors` WHERE `Deleted` = 0 AND `Capturing` != 'None' AND `RTSPServer` != false]
02/12/24 18:42:48.084862 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/2540 [Got 4 monitors]
02/12/24 18:42:48.084911 zm_rtsp_server[2626233].DB2-zm_storage.cpp/61 [Loading Storage for 1 using SELECT `Id`, `Name`, `Path`, `Type`, `Scheme` FROM `Storage` WHERE `Id`=1]
02/12/24 18:42:48.085142 zm_rtsp_server[2626233].DB1-zm_storage.cpp/79 [Loaded Storage area 1 'Default']
02/12/24 18:42:48.085162 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/399 [Have camera type Ffmpeg]
02/12/24 18:42:48.085178 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/739 [Setting pre_event_video_packet_count to 50]
02/12/24 18:42:48.085185 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/733 [Setting max_video_packet_count to 750]
02/12/24 18:42:48.085210 zm_rtsp_server[2626233].DB2-zm_storage.cpp/61 [Loading Storage for 1 using SELECT `Id`, `Name`, `Path`, `Type`, `Scheme` FROM `Storage` WHERE `Id`=1]
02/12/24 18:42:48.085376 zm_rtsp_server[2626233].DB1-zm_storage.cpp/79 [Loaded Storage area 1 'Default']
02/12/24 18:42:48.085394 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/399 [Have camera type Ffmpeg]
02/12/24 18:42:48.085405 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/739 [Setting pre_event_video_packet_count to 20]
02/12/24 18:42:48.085412 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/733 [Setting max_video_packet_count to 700]
02/12/24 18:42:48.085436 zm_rtsp_server[2626233].DB2-zm_storage.cpp/61 [Loading Storage for 1 using SELECT `Id`, `Name`, `Path`, `Type`, `Scheme` FROM `Storage` WHERE `Id`=1]
02/12/24 18:42:48.085608 zm_rtsp_server[2626233].DB1-zm_storage.cpp/79 [Loaded Storage area 1 'Default']
02/12/24 18:42:48.085627 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/399 [Have camera type Ffmpeg]
02/12/24 18:42:48.085637 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/739 [Setting pre_event_video_packet_count to 20]
02/12/24 18:42:48.085643 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/733 [Setting max_video_packet_count to 400]
02/12/24 18:42:48.085666 zm_rtsp_server[2626233].DB2-zm_storage.cpp/61 [Loading Storage for 1 using SELECT `Id`, `Name`, `Path`, `Type`, `Scheme` FROM `Storage` WHERE `Id`=1]
02/12/24 18:42:48.085819 zm_rtsp_server[2626233].DB1-zm_storage.cpp/79 [Loaded Storage area 1 'Default']
02/12/24 18:42:48.085836 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/399 [Have camera type Ffmpeg]
02/12/24 18:42:48.085846 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/739 [Setting pre_event_video_packet_count to 25]
02/12/24 18:42:48.085852 zm_rtsp_server[2626233].DB1-zm_packetqueue.cpp/733 [Setting max_video_packet_count to 400]
02/12/24 18:42:48.085903 zm_rtsp_server[2626233].DB1-zm_rtsp_server.cpp/179 [Found monitor in oldmonitors, clearing it]
02/12/24 18:42:48.085917 zm_rtsp_server[2626233].DB1-zm_rtsp_server.cpp/179 [Found monitor in oldmonitors, clearing it]
02/12/24 18:42:48.085924 zm_rtsp_server[2626233].DB1-zm_rtsp_server.cpp/179 [Found monitor in oldmonitors, clearing it]
02/12/24 18:42:48.085930 zm_rtsp_server[2626233].DB1-zm_rtsp_server.cpp/179 [Found monitor in oldmonitors, clearing it]
02/12/24 18:42:51.121087 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/3406 [Stopping packetqueue]
02/12/24 18:42:51.121276 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/3406 [Stopping packetqueue]
02/12/24 18:42:51.121319 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/3406 [Stopping packetqueue]
02/12/24 18:42:51.121359 zm_rtsp_server[2626233].DB1-zm_monitor.cpp/3406 [Stopping packetqueue]
02/12/24 18:42:51.121398 zm_rtsp_server[2626233].INF-zm_rtsp_server.cpp/333 [RTSP Server shutting down]
02/12/24 18:42:51.121420 zm_rtsp_server[2626233].DB1-zm_rtsp_server_fifo_source.cpp/42 [Deleting Fifo Source]
02/12/24 18:42:51.121848 zm_rtsp_server[2626233].DB1-zm_rtsp_server_fifo_source.cpp/48 [Deleting Fifo Source done]
02/12/24 18:42:51.121883 zm_rtsp_server[2626233].DB1-zm_rtsp_server.cpp/344 [Removing session for Front Deck]
02/12/24 18:42:51.121925 zm_rtsp_server[2626233].DB1-zm_rtsp_server_fifo_source.cpp/42 [Deleting Fifo Source]
02/12/24 18:42:51.122695 zm_rtsp_server[2626233].DB1-zm_rtsp_server_fifo_source.cpp/48 [Deleting Fifo Source done]
02/12/24 18:42:51.122752 zm_rtsp_server[2626233].DB1-zm_rtsp_server.cpp/344 [Removing session for Deck South]
02/12/24 18:42:51.122772 zm_rtsp_server[2626233].DB1-zm_rtsp_server_fifo_source.cpp/42 [Deleting Fifo Source]
02/12/24 18:42:51.133123 zm_rtsp_server[2626736].ERR-zm_signal.cpp/50 [Got signal 6 (Aborted), crashing]
02/12/24 18:42:51.133251 zm_rtsp_server[2626736].DB1-zm_signal.cpp/57 [Signal information: number 6 code -6 errno 0 pid 2626233 uid 33 status 0]
02/12/24 18:42:51.133263 zm_rtsp_server[2626736].ERR-zm_signal.cpp/82 [Signal address is 0x21002812b9, from 0x7f0b4be029fc]
02/12/24 18:42:51.136724 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 0: /usr/bin/zm_rtsp_server(+0x8bef2) [0x5564c47e5ef2]]
02/12/24 18:42:51.136788 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0b4bdae520]]
02/12/24 18:42:51.136809 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 2: /lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c) [0x7f0b4be029fc]]
02/12/24 18:42:51.136829 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 3: /lib/x86_64-linux-gnu/libc.so.6(raise+0x16) [0x7f0b4bdae476]]
02/12/24 18:42:51.136850 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 4: /lib/x86_64-linux-gnu/libc.so.6(abort+0xd3) [0x7f0b4bd947f3]]
02/12/24 18:42:51.136868 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e) [0x7f0b4c13eb9e]]
02/12/24 18:42:51.136888 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c) [0x7f0b4c14a20c]]
02/12/24 18:42:51.136905 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277) [0x7f0b4c14a277]]
02/12/24 18:42:51.136925 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 8: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xaefa5) [0x7f0b4c14afa5]]
02/12/24 18:42:51.136942 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 9: /usr/bin/zm_rtsp_server(+0x8b20c) [0x5564c47e520c]]
02/12/24 18:42:51.136962 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 10: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xdc253) [0x7f0b4c178253]]
02/12/24 18:42:51.136975 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 11: /lib/x86_64-linux-gnu/libc.so.6(+0x94ac3) [0x7f0b4be00ac3]]
02/12/24 18:42:51.136997 zm_rtsp_server[2626736].ERR-zm_signal.cpp/107 [Backtrace 12: /lib/x86_64-linux-gnu/libc.so.6(+0x126850) [0x7f0b4be92850]]
02/12/24 18:42:51.137010 zm_rtsp_server[2626736].ERR-zm_signal.cpp/126 [Backtrace complete, please install debug symbols (typically zoneminder-dbg)]
02/12/24 18:42:51.137049 zm_rtsp_server[2626736].ERR-zm_signal.cpp/127 [and execute the following command for more information:]
02/12/24 18:42:51.137068 zm_rtsp_server[2626267].DB1-zm_db.cpp/205 [Success running sql query INSERT INTO `Logs` ( `TimeKey`, `Component`, `ServerId`, `Pid`, `Level`, `Code`, `Message`, `File`, `Line` ) VALUES ( 1707792171.133123, 'zm_rtsp_server', 0, 2626736, -2, 'ERR', 'Got signal 6 (Aborted), crashing', 'zm_signal.cpp', 50 ), thread_id: 1413274]
02/12/24 18:42:51.137145 zm_rtsp_server[2626736].ERR-zm_signal.cpp/128 [addr2line -Cfip -e /usr/bin/zm_rtsp_server 0x8bef2 0x8b20c]
02/12/24 18:43:00.919578 zm_rtsp_server[2640240].DB1-zm_logger.cpp/225 [LogOpts: level=DB2 effective=DB2, screen=OFF, database=ERR, logfile=DB9->/var/log/zm/zm_rtsp_server.log, syslog=WAR]
02/12/24 18:43:00.919912 zm_rtsp_server[2640240].DB1-zm_utils.cpp/228 [Detected a x86\x86-64 processor with AVX2]
02/12/24 18:43:00.920045 zm_rtsp_server[2640240].INF-zm_rtsp_server.cpp/145 [Starting RTSP Server version 1.37.50]

Any help is appreciated.

Thanks!

[iconnor]

Please install zoneminder-dbg and crank the debug level up to 3. I push a new build with more debugging in it.

[EK701]

Please install zoneminder-dbg and crank the debug level up to 3. I push a new build with more debugging in it.

Installed, updated and logging now. I'll post if/when it crashes.

[EK701]

Please install zoneminder-dbg and crank the debug level up to 3. I push a new build with more debugging in it.

As a side note, setting LOG_DEBUG_TARGET to "_rtsp" or "_rtsp_server" does not appear to work. If I leave LOG_DEBUG_TARGET empty, I get the zm_rtsp_server debug logs. Using the two strings above, I get nothing.

Just an FYI.