Released 1.36.30,31 The Memory Remains

Discussions related to the 1.36.x series of ZoneMinder
User avatar
iconnor
Posts: 3197
Joined: Fri Oct 29, 2010 1:43 am
Location: Toronto
Contact:

Released 1.36.30,31 The Memory Remains

Post by iconnor »

#Changes since 1.36.29

- Test for definition of ZM_LOG_INJECT. We don't include the config when not logged in. So it won't be defined and an error will be logged
- Fix saving from the function modal (and other modals)
- left align option value column
- when a config value is overridden via *.conf files, put up a warning/explanation on the options view
- Turn failure to send into a debug instead of warn. When running under fpm etc we may not get SIGPIPE.
- Move relevant code out of includes/actions/auth.php into includes/auth.php. Fixes inability to login using GET method.
- Don't panic if no font file found. We seem to be able to continue without it.
- Rework session handling to fix breakage with php8.2. Please note that php 8.2 still completely breaks a ton of our code. Do not upgrade to php8.2 and expect ZoneMinder to work.

**Full Changelog**: https://github.com/ZoneMinder/zoneminde ... ...1.36.30

# Changes since 1.36.30

- Fix failed login due to remoteAddr not being populated in session after regeneration
- Use REQUEST instead of SESSION to store the post login redirect because we clear the session on login. Fixes #3517
- Turn off logging of deprecation notices so that we work with php8.2

**Full Changelog**: https://github.com/ZoneMinder/zoneminde ... ...1.36.31
ChuckSmith
Posts: 7
Joined: Wed Jul 21, 2021 12:10 pm

Re: Released 1.36.30,31 The Memory Remains

Post by ChuckSmith »

On 1.36.29, and now on 1.36.31, I am seeing zmc out of memory errors.

[ 5219.254304] Out of memory: Killed process 6764 (zmc) total-vm:10909028kB, anon-rss:7081588kB, file-rss:1356kB, shmem-rss:59056kB, UID: 33, pgtables:19588kB oom_score_adj:0
tinymouse
Posts: 23
Joined: Sat Apr 02, 2022 11:36 pm

Re: Released 1.36.30,31 The Memory Remains

Post by tinymouse »

I have noticed that after update of 30/31 that my /dev/shm is growing and sometimes quickly. Prior, to 1.36.30 it was steady at about 22%-24%, Yesterday it hit 100% and zm started crashing . a restart of zm cleard this out and the /dev/shm is now at 20%. Here is what I found. Many entries in the /dev/shm that say "deleted" but must still be there? Using the lsof /dev/shm shows:

sudo lsof /dev/shm

COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
postgres 1556 postgres mem REG 0,26 16192 3 /dev/shm/PostgreSQL.1803989040
postgres 1681 postgres mem REG 0,26 16192 3 /dev/shm/PostgreSQL.1803989040
postgres 1682 postgres mem REG 0,26 16192 3 /dev/shm/PostgreSQL.1803989040
postgres 1683 postgres mem REG 0,26 16192 3 /dev/shm/PostgreSQL.1803989040
postgres 1684 postgres mem REG 0,26 16192 3 /dev/shm/PostgreSQL.1803989040
postgres 1686 postgres mem REG 0,26 16192 3 /dev/shm/PostgreSQL.1803989040
zmc 3785 www-data mem REG 0,26 58987976 8 /dev/shm/zm.mmap.9
zmc 3785 www-data mem REG 0,26 5739976 10 /dev/shm/zm.mmap.10
zmc 3785 www-data 4u REG 0,26 58987976 8 /dev/shm/zm.mmap.9
zmc 3785 www-data 6u REG 0,26 4306360 9 /dev/shm/zm.mmap.10 (deleted)
zmc 3785 www-data 7u REG 0,26 5739976 16 /dev/shm/zm.mmap.10 (deleted)
zmc 3785 www-data 8u REG 0,26 5739976 10 /dev/shm/zm.mmap.10
zmc 24934 www-data mem REG 0,26 33183176 6 /dev/shm/zm.mmap.3
zmc 24934 www-data DEL REG 0,26 58 /dev/shm/zm.mmap.2
zmc 24934 www-data DEL REG 0,26 51 /dev/shm/zm.mmap.2
zmc 24934 www-data DEL REG 0,26 48 /dev/shm/zm.mmap.2
zmc 24934 www-data DEL REG 0,26 46 /dev/shm/zm.mmap.2
zmc 24934 www-data DEL REG 0,26 34 /dev/shm/zm.mmap.2
zmc 24934 www-data 4u REG 0,26 33183176 6 /dev/shm/zm.mmap.3
zmc 24934 www-data 6u REG 0,26 33183176 37 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 7u REG 0,26 33183176 13 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 8u REG 0,26 33183176 14 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 9u REG 0,26 33183176 18 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 10u REG 0,26 33183176 19 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 11u REG 0,26 33183176 20 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 12u REG 0,26 33183176 21 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 13u REG 0,26 33183176 22 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 14u REG 0,26 33183176 4 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 15u REG 0,26 33183176 25 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 16u REG 0,26 33183176 26 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 17u REG 0,26 33183176 27 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 18u REG 0,26 33183176 28 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 19u REG 0,26 33183176 29 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 20u REG 0,26 33183176 30 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 21u REG 0,26 33183176 31 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 22u REG 0,26 33183176 32 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 23u REG 0,26 33183176 34 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 24u REG 0,26 33183176 39 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 25u REG 0,26 33183176 41 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 26u REG 0,26 33183176 46 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 27u REG 0,26 33183176 47 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 28u REG 0,26 33183176 48 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 29u REG 0,26 33183176 51 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 30u REG 0,26 33183176 53 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 31u REG 0,26 33183176 55 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 32u REG 0,26 33183176 57 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 33u REG 0,26 33183176 58 /dev/shm/zm.mmap.2 (deleted)
zmc 24934 www-data 34u REG 0,26 33183176 61 /dev/shm/zm.mmap.2 (deleted)
zmc 24987 www-data mem REG 0,26 33183176 63 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 62 /dev/shm/zm.mmap.7
zmc 24987 www-data mem REG 0,26 33183176 5 /dev/shm/zm.mmap.4
zmc 24987 www-data DEL REG 0,26 60 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 59 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 56 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 54 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 52 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 50 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 49 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 45 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 44 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 43 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 42 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 40 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 38 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 36 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 33 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 23 /dev/shm/zm.mmap.7
zmc 24987 www-data DEL REG 0,26 17 /dev/shm/zm.mmap.7
zmc 24987 www-data 4u REG 0,26 33183176 5 /dev/shm/zm.mmap.4
zmc 24987 www-data 6u REG 0,26 33183176 35 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 7u REG 0,26 33183176 11 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 8u REG 0,26 33183176 15 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 9u REG 0,26 33183176 17 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 10u REG 0,26 33183176 23 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 11u REG 0,26 33183176 33 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 12u REG 0,26 33183176 36 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 13u REG 0,26 33183176 38 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 14u REG 0,26 33183176 40 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 15u REG 0,26 33183176 42 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 16u REG 0,26 33183176 43 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 17u REG 0,26 33183176 44 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 18u REG 0,26 33183176 45 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 19u REG 0,26 33183176 49 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 20u REG 0,26 33183176 50 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 21u REG 0,26 33183176 52 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 22u REG 0,26 33183176 54 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 23u REG 0,26 33183176 56 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 24u REG 0,26 33183176 59 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 25u REG 0,26 33183176 60 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 26u REG 0,26 33183176 62 /dev/shm/zm.mmap.7 (deleted)
zmc 24987 www-data 27u REG 0,26 33183176 63 /dev/shm/zm.mmap.7
zmc 25156 www-data mem REG 0,26 5739976 10 /dev/shm/zm.mmap.10
zmc 25156 www-data 4u REG 0,26 5739976 10 /dev/shm/zm.mmap.10
zmc 25317 www-data mem REG 0,26 33183176 12 /dev/shm/zm.mmap.8
zmc 25317 www-data 4u REG 0,26 33183176 12 /dev/shm/zm.mmap.8
zmc 25358 www-data mem REG 0,26 33183176 24 /dev/shm/zm.mmap.15
zmc 25358 www-data 4u REG 0,26 33183176 24 /dev/shm/zm.mmap.15
zmc 96730 www-data mem REG 0,26 47781320 7 /dev/shm/zm.mmap.1
zmc 96730 www-data 4u REG 0,26 47781320 7 /dev/shm/zm.mmap.1
zmc 97708 www-data mem REG 0,26 33183176 63 /dev/shm/zm.mmap.7
zmc 97708 www-data 4u REG 0,26 33183176 63 /dev/shm/zm.mmap.7
zmc 97717 www-data mem REG 0,26 33183176 64 /dev/shm/zm.mmap.2
zmc 97717 www-data 4u REG 0,26 33183176 64 /dev/shm/zm.mmap.2

From the log: (probably due to /dev/shm being 100%)
Date/Time,Component,Server,PID,Level,Message,File,Line
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Backtrace 6: /usr/bin/zmc(+0x3fb2e) [0x55ab8e435b2e]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Backtrace 5: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7fc661101083]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Backtrace 4: /usr/bin/zmc(+0x3cf02) [0x55ab8e432f02]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Backtrace 3: /usr/bin/zmc(+0x6a50d) [0x55ab8e46050d]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Backtrace 2: /lib/x86_64-linux-gnu/libc.so.6(+0x18bb41) [0x7fc661268b41]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Backtrace 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fc663966420]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Backtrace 0: /usr/bin/zmc(+0xc44e1) [0x55ab8e4ba4e1]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Signal address is 0x7fc658e31000, from 0x7fc661268b41",zm_signal.cpp,80
"Fri 10/21/2022 04:52:40",zmc_m2,,171984,ERR,"Got signal 7 (Bus error), crashing",zm_signal.cpp,50
"Fri 10/21/2022 04:52:39",zmdc,,3359,ERR,"'zmc -m 2' exited abnormally, exit status 7",zmdc.pl,'-
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Backtrace 6: /usr/bin/zmc(+0x3fb2e) [0x562d08a37b2e]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Backtrace 5: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7f31160b0083]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Backtrace 4: /usr/bin/zmc(+0x3cf02) [0x562d08a34f02]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Backtrace 3: /usr/bin/zmc(+0x6a50d) [0x562d08a6250d]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Backtrace 2: /lib/x86_64-linux-gnu/libc.so.6(+0x18bb41) [0x7f3116217b41]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Backtrace 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f3118915420]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Backtrace 0: /usr/bin/zmc(+0xc44e1) [0x562d08abc4e1]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Signal address is 0x7f310dde0000, from 0x7f3116217b41",zm_signal.cpp,80
"Fri 10/21/2022 04:52:39",zmc_m2,,171981,ERR,"Got signal 7 (Bus error), crashing",zm_signal.cpp,50
"Fri 10/21/2022 04:52:37",zmdc,,3359,ERR,"'zmc -m 2' exited abnormally, exit status 7",zmdc.pl,'-
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Backtrace 6: /usr/bin/zmc(+0x3fb2e) [0x5582b36b8b2e]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Backtrace 5: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7f996d79d083]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Backtrace 4: /usr/bin/zmc(+0x3cf02) [0x5582b36b5f02]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Backtrace 3: /usr/bin/zmc(+0x6a50d) [0x5582b36e350d]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Backtrace 2: /lib/x86_64-linux-gnu/libc.so.6(+0x18bb41) [0x7f996d904b41]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Backtrace 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f9970002420]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Backtrace 0: /usr/bin/zmc(+0xc44e1) [0x5582b373d4e1]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Signal address is 0x7f99654cd000, from 0x7f996d904b41",zm_signal.cpp,80
"Fri 10/21/2022 04:52:37",zmc_m2,,171971,ERR,"Got signal 7 (Bus error), crashing",zm_signal.cpp,50
"Fri 10/21/2022 04:52:31",zmdc,,3359,ERR,"'zmc -m 2' exited abnormally, exit status 7",zmdc.pl,'-
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Backtrace 6: /usr/bin/zmc(+0x3fb2e) [0x55648dc27b2e]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Backtrace 5: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7ff6a7931083]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Backtrace 4: /usr/bin/zmc(+0x3cf02) [0x55648dc24f02]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Backtrace 3: /usr/bin/zmc(+0x6a50d) [0x55648dc5250d]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Backtrace 2: /lib/x86_64-linux-gnu/libc.so.6(+0x18bb41) [0x7ff6a7a98b41]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Backtrace 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7ff6aa196420]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Backtrace 0: /usr/bin/zmc(+0xc44e1) [0x55648dcac4e1]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Signal address is 0x7ff69f661000, from 0x7ff6a7a98b41",zm_signal.cpp,80
"Fri 10/21/2022 04:52:31",zmc_m2,,171964,ERR,"Got signal 7 (Bus error), crashing",zm_signal.cpp,50
"Fri 10/21/2022 04:52:30",zmdc,,3359,ERR,"'zmc -m 2' exited abnormally, exit status 7",zmdc.pl,'-
"Fri 10/21/2022 04:52:29",zmc_m2,,171961,ERR,"Backtrace 6: /usr/bin/zmc(+0x3fb2e) [0x55c851954b2e]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:29",zmc_m2,,171961,ERR,"Backtrace 5: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7fb1983f0083]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:29",zmc_m2,,171961,ERR,"Backtrace 4: /usr/bin/zmc(+0x3cf02) [0x55c851951f02]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:29",zmc_m2,,171961,ERR,"Backtrace 3: /usr/bin/zmc(+0x6a50d) [0x55c85197f50d]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:29",zmc_m2,,171961,ERR,"Backtrace 2: /lib/x86_64-linux-gnu/libc.so.6(+0x18bb41) [0x7fb198557b41]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:29",zmc_m2,,171961,ERR,"Backtrace 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fb19ac55420]",zm_signal.cpp,101
"Fri 10/21/2022 04:52:29",zmc_m2,,171961,ERR,"Backtrace 0: /usr/bin/zmc(+0xc44e1) [0x55c8519d94e1]",zm_signal.cpp,101

From zmcwatch.log.1
10/20/2022 05:37:17.028197 zmwatch[4367].ERR [ZoneMinder::Memory::Mapped:90] [Memory map file '/dev/shm/zm.mmap.2' does not exist in zmMemAttach. zmc might not be running.]
10/20/2022 05:37:27.196779 zmwatch[4367].ERR [ZoneMinder::Memory::Mapped:90] [Memory map file '/dev/shm/zm.mmap.2' does not exist in zmMemAttach. zmc might not be running.]
10/20/2022 05:43:37.738909 zmwatch[4367].ERR [ZoneMinder::Memory::Mapped:90] [Memory map file '/dev/shm/zm.mmap.2' does not exist in zmMemAttach. zmc might not be running.]
10/20/2022 05:43:47.843027 zmwatch[4367].ERR [ZoneMinder::Memory::Mapped:90] [Memory map file '/dev/shm/zm.mmap.2' does not exist in zmMemAttach. zmc might not be running.]
10/20/2022 05:48:18.440606 zmwatch[4367].ERR [ZoneMinder::Memory::Mapped:90] [Memory map file '/dev/shm/zm.mmap.2' does not exist in zmMemAttach. zmc might not be running.]
10/20/2022 05:48:28.576144 zmwatch[4367].ERR [ZoneMinder::Memory::Mapped:90] [Memory map file '/dev/shm/zm.mmap.2' does not exist in zmMemAttach. zmc might not be running.]
User avatar
iconnor
Posts: 3197
Joined: Fri Oct 29, 2010 1:43 am
Location: Toronto
Contact:

Re: Released 1.36.30,31 The Memory Remains

Post by iconnor »

There where very minimal changes to the c++ code between 1.36.29 and 1.36.31. It was all mostly on the php side. So I don't know what's going on.

You will have to turn on debugging and look at the logs.

The 100% shm is interesting. Yes being out of shm will cause crashing, but what's with all the deleted mmaps? Do you have zombie's?

Logs.
codabiz
Posts: 59
Joined: Sun Jan 04, 2009 10:16 am
Location: London, UK

Re: Released 1.36.30,31 The Memory Remains [Solved]

Post by codabiz »

Running Ubuntu server 18.04.5

Was on ZM 1.36.26, then upgraded to 1.36.31. Upgrade worked fine and the database upgraded ok.. Following a restart I got:

ZoneMinder Error
Unable to connect to ZM db using dsn mysql:host=localhost;dbname=zm

could not find driver

ZoneMinder will retry connection in * seconds.

Logs: /var/log/mysql/error.log

2022-10-22 13:59:37 140111074806912 [Note] InnoDB: Using Linux native AIO
2022-10-22 13:59:37 140111074806912 [Note] InnoDB: Using SSE crc32 instructions
2022-10-22 13:59:37 140111074806912 [Note] InnoDB: Initializing buffer pool, size = 128.0M
2022-10-22 13:59:37 140111074806912 [Note] InnoDB: Completed initialization of buffer pool
2022-10-22 13:59:37 140111074806912 [Note] InnoDB: Highest supported file format is Barracuda.
2022-10-22 13:59:39 140111074806912 [Note] InnoDB: 128 rollback segment(s) are active.
2022-10-22 13:59:39 140111074806912 [Note] InnoDB: Waiting for purge to start
2022-10-22 13:59:39 140111074806912 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.49-89.0 started; log sequence number 1720425344
2022-10-22 13:59:39 140111074806912 [Note] Plugin 'FEEDBACK' is disabled.
2022-10-22 13:59:39 140110402156288 [Note] InnoDB: Dumping buffer pool(s) not yet started
2022-10-22 13:59:39 140111074806912 [Note] Server socket created on IP: '127.0.0.1'.
2022-10-22 13:59:39 140111074806912 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.1.48-MariaDB-0ubuntu0.18.04.1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Ubuntu 18.04

[Solved] I ran:

sudo apt install php8.1-intl

systemctl restart apache2

[Explanation] I had been using php 7.4 and thought I had upgraded to php 8.1 - possible there were conflicting php entries which manifested on the restart.
Last edited by codabiz on Mon Oct 24, 2022 10:22 am, edited 2 times in total.
tinymouse
Posts: 23
Joined: Sat Apr 02, 2022 11:36 pm

Re: Released 1.36.30,31 The Memory Remains

Post by tinymouse »

Some background: I have 3 Wyze v3 cams all in use a several months ago; two of which are using the mini-hacks from GitHub; id# 2 and id#7; the third is using rstp firmware from Wyze and is working fine; the other two are the problem now....so I suspect that this wyze mini-hack firmware may be the issued.
I was not sure what debug level to choose, so I selected level 3; and component _zm_m2 which is the main problem. After I started the debug and soon after, my log started getting the following; hundreds of these:

Date/Time,Component,PID,Level,Message,File,Line
"Sat 10/22/2022 11:23:30",zmc_m2,72872,WAR,"error while decoding MB 57 60, bytestream -50",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:23:23",zmc_m2,72872,WAR,"error while decoding MB 77 15, bytestream -13",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:23:21",zmc_m2,72872,WAR,"error while decoding MB 59 34, bytestream -19",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:23:17",zmc_m2,72872,WAR,"error while decoding MB 102 25, bytestream -21",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:23:01",zmc_m2,72872,WAR,"error while decoding MB 101 16, bytestream -9",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:50",zmc_m2,72872,WAR,"error while decoding MB 27 64, bytestream -35",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:42",zmc_m2,72872,WAR,"error while decoding MB 42 54, bytestream -5",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:33",zmc_m2,72872,WAR,"error while decoding MB 91 23, bytestream -19",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:20",zmc_m2,72872,WAR,"error while decoding MB 0 23, bytestream 92509",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:20",zmc_m2,72872,WAR,"left block unavailable for requested intra mode",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:11",zmc_m2,72872,WAR,"error while decoding MB 28 55, bytestream -9",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:07",zmc_m2,72872,WAR,"error while decoding MB 20 28, bytestream -11",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:22:06",zmc_m2,72872,WAR,"error while decoding MB 8 47, bytestream -11",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:21:59",zmc_m2,72872,WAR,"error while decoding MB 119 46, bytestream -25",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:21:51",zmc_m2,72872,WAR,"error while decoding MB 0 35, bytestream 23258",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:21:51",zmc_m2,72872,WAR,"left block unavailable for requested intra4x4 mode -1",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:21:47",zmc_m2,72872,WAR,"error while decoding MB 55 25, bytestream -29",zm_ffmpeg.cpp,69
"Sat 10/22/2022 11:21:29",zmc_m2,72872,WAR,"error while decoding MB 23 39, bytestream -29",zm_ffmpeg.cpp,69

So I turned logging off and I do have some logs; size from up to 400mb. too much logging?
User avatar
iconnor
Posts: 3197
Joined: Fri Oct 29, 2010 1:43 am
Location: Toronto
Contact:

Re: Released 1.36.30,31 The Memory Remains

Post by iconnor »

So the question is did these work before 1.36.30? Cuz I really havn't changed anything on the c++ side in while.

Those errors tell me that ffmpeg doesn't like the stream, maybe not enough cpu or too many dropped packets.
tinymouse
Posts: 23
Joined: Sat Apr 02, 2022 11:36 pm

Re: Released 1.36.30,31 The Memory Remains

Post by tinymouse »

I should have checked this first; Think I found the issue. If you noticed all the dead zombie tasks they all have the the same PID. When I did a lookup of the that PID, turns out to be a different monitor....sort of.. below is a small list, you'll see pid 87536 with /dev/shm/zm.mmap.7 (deleted) AND with /dev/shm/zm.mmap.4. So I think this has something to do with linked monitors. I have disabled the linked monitors and re-started them. I'll watch and see.

zmc -4 is a LINKED monitor to zmc -7 (true for my zmc -3 linked to zmc -2)

COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
zmc 87536 www-data 4u REG 0,26 33183176 6 /dev/shm/zm.mmap.4
zmc 87536 www-data 6u REG 0,26 33183176 10 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 7u REG 0,26 33183176 12 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 8u REG 0,26 33183176 13 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 9u REG 0,26 33183176 14 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 10u REG 0,26 33183176 16 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 11u REG 0,26 33183176 17 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 12u REG 0,26 33183176 18 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 13u REG 0,26 33183176 19 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 14u REG 0,26 33183176 20 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 15u REG 0,26 33183176 21 /dev/shm/zm.mmap.7 (deleted)
zmc 87536 www-data 16u REG 0,26 33183176 22 /dev/shm/zm.mmap.7

[tb@ToyBot:/home/tb]$ ps -ef | grep 87536
www-data 87536 2787 31 Oct22 ? 12:19:54 /usr/bin/zmc -m 4

EDIT: This just happened to coincide when I upgraded to 1.36.30/31 and did a couple of linked monitors, so it may have nothing to do with this update....just fyi
boris.yordanov
Posts: 2
Joined: Fri Oct 28, 2022 6:17 pm

Re: Released 1.36.30,31 The Memory Remains

Post by boris.yordanov »

Now at 1.36.31 (on Ubuntu 20.04.5 LTS) and cannot delete zones (at least this is what I've found, yet). Whenever i try to delete a zone I get this log entry:

Code: Select all

web_php		1975271	ERR	actions can no longer be performed without POST.	/usr/share/zoneminder/www/index.php
Any ideas how to work around it?
User avatar
iconnor
Posts: 3197
Joined: Fri Oct 29, 2010 1:43 am
Location: Toronto
Contact:

Re: Released 1.36.30,31 The Memory Remains

Post by iconnor »

add my proposed ppa to get the 1.36.32 pre-release.

sudo add-apt-repository ppa:iconnor/zoneminder-proposed
sudo apt-get install zoneminder
boris.yordanov
Posts: 2
Joined: Fri Oct 28, 2022 6:17 pm

Re: Released 1.36.30,31 The Memory Remains

Post by boris.yordanov »

Yup, fixed. Thank you.
bbunge
Posts: 2951
Joined: Mon Mar 26, 2012 11:40 am
Location: Pennsylvania

Re: Released 1.36.30,31 The Memory Remains

Post by bbunge »

Ubuntu 22.10 install fails with unmet dependencies: needs libswscale4 or 5 and libswresample2 or 3

libswscale6 and libswresample4 are available in 22.10
User avatar
iconnor
Posts: 3197
Joined: Fri Oct 29, 2010 1:43 am
Location: Toronto
Contact:

Re: Released 1.36.30,31 The Memory Remains

Post by iconnor »

Thanks for the heads up. Will be supported in 1.36.32.
Jay_from_NuZiland
Posts: 2
Joined: Sun Jun 13, 2021 2:58 am

Re: Released 1.36.30,31 The Memory Remains

Post by Jay_from_NuZiland »

boris.yordanov wrote: Fri Oct 28, 2022 6:21 pm Now at 1.36.31 (on Ubuntu 20.04.5 LTS) and cannot delete zones (at least this is what I've found, yet). Whenever i try to delete a zone I get this log entry:

Code: Select all

web_php		1975271	ERR	actions can no longer be performed without POST.	/usr/share/zoneminder/www/index.php
Any ideas how to work around it?
I have this issue too, but am running a docker instance so adding the `proposed` ppa is not quite so easy.
Is there a workaround I can do using a POST command via curl? I see the url that is attempted via the browser url bar, which looks to contain the commands needed:

Code: Select all

http://192.168.220.11/index.php?view=zones&action=delete&mids%5B%5D=2&markZids%5B%5D=6&deleteBtn=Delete
can this be reformatted into a curl POST with appropriate --data parameters to achieve what I want to do?
User avatar
iconnor
Posts: 3197
Joined: Fri Oct 29, 2010 1:43 am
Location: Toronto
Contact:

Re: Released 1.36.30,31 The Memory Remains

Post by iconnor »

Edit the zones view and change the method="get" to method="post" in the form tag.
Post Reply