"Cascade" of camera failures
Posted: Sun Jun 30, 2019 7:00 pm
I have been running a Zoneminder setup for about 2 years now, initially with 4 cameras on it (mostly Wansviews) now up to 7.
I recently updated to 1.32.x and have been struggling with a number of issues, but recently noticed something very odd that I'm trying to give more though to and gather more information on.
My cameras failures seem to "cascade"; when one of them is having connectivity issues, it will then propagate to other cameras causing more failures in the ZMC processes. These are characterized by Errors stating that the mapping file size did not match the expected, which seems to cause the ZMC processes to restart and attempt to reconnect?
This is typically caused by a particular camera that I received that frequently needs to be power cycled to recover that I haven't diagnosed yet.
Obvious thoughts:
1. Does my wireless just suck?
This was my prevailing concern for a long time, particularly after tweaking the performance a great deal in 1.30. However, if I take the problem camera, disable it fulling in ZM, all 6 other cameras work without issue. The first time I figured this out I actually had all 6 other cameras run without any errors for almost a solid week, which has never happened in my history of running ZM.
2. Perhaps this is a symptom of whatever is wrong with that one camera?
Until today I would have believed that, but I had to rearrange some furniture/equipment which affected the signal of yet another camera. Once this one failed to connect, I began to witness the cascade effect yet again.
3. Is it the performance of the box?
It is certainly a weak machine I'm running ZM on, however the temp file system is less than half full at any time; I am nowhere near using all of my available memory (all cameras are tweaked to 2FPS running at 720p). CPU usage rarely peaks above even 40% and the Load is below 1.0 unless I'm running a Montage. I also have all cameras capped in ZM at 3fps max, so that the disconnection doesn't cause runaway CPU usage.
4. Cheap cameras are the problem?
It may indeed be the Wansview W3, which are 6 of my 7 cameras. However, even during these issues, the cameras zoneminder is unable to get back connected to respond via their own interfaces and appear to be fine.
Has anyone else witnessed something like this? I'm open to any ideas on what to look at next or what to try to diagnose.
Thanks for any help/advice!
EDIT: Added #4.
I recently updated to 1.32.x and have been struggling with a number of issues, but recently noticed something very odd that I'm trying to give more though to and gather more information on.
My cameras failures seem to "cascade"; when one of them is having connectivity issues, it will then propagate to other cameras causing more failures in the ZMC processes. These are characterized by Errors stating that the mapping file size did not match the expected, which seems to cause the ZMC processes to restart and attempt to reconnect?
This is typically caused by a particular camera that I received that frequently needs to be power cycled to recover that I haven't diagnosed yet.
Obvious thoughts:
1. Does my wireless just suck?
This was my prevailing concern for a long time, particularly after tweaking the performance a great deal in 1.30. However, if I take the problem camera, disable it fulling in ZM, all 6 other cameras work without issue. The first time I figured this out I actually had all 6 other cameras run without any errors for almost a solid week, which has never happened in my history of running ZM.
2. Perhaps this is a symptom of whatever is wrong with that one camera?
Until today I would have believed that, but I had to rearrange some furniture/equipment which affected the signal of yet another camera. Once this one failed to connect, I began to witness the cascade effect yet again.
3. Is it the performance of the box?
It is certainly a weak machine I'm running ZM on, however the temp file system is less than half full at any time; I am nowhere near using all of my available memory (all cameras are tweaked to 2FPS running at 720p). CPU usage rarely peaks above even 40% and the Load is below 1.0 unless I'm running a Montage. I also have all cameras capped in ZM at 3fps max, so that the disconnection doesn't cause runaway CPU usage.
4. Cheap cameras are the problem?
It may indeed be the Wansview W3, which are 6 of my 7 cameras. However, even during these issues, the cameras zoneminder is unable to get back connected to respond via their own interfaces and appear to be fine.
Has anyone else witnessed something like this? I'm open to any ideas on what to look at next or what to try to diagnose.
Thanks for any help/advice!
EDIT: Added #4.