Network Gremlins - Need Some Help

S

ShawnInPaso

Getting the hang of it
May 30, 2016
135
73
I've been running a network of 10 IP cams for a long time without issue (excepting one cable prob), using the same devices and cameras. About a week ago, the gremlins created a problem, which I describe as follows. I have a 4 port switch that has cameras attached, and all of these cameras fail at the same time at random intervals, Maybe they will work for 30 minutes or 5 hours, usually shorter durations. When I remove and restore power to the 4 port switch, the cameras will start again and the cycle repeats. Also, when they fail, I can bring them back to life by simply unplugging the cat5 cable from the 16 port switch (see diagram) and plugging the cable back in. Again, the cycle repeats itself. The other 6 cams on the 16 port switch are not affected/run fine. Below is a list of things I've done or checked in my failed efforts to correct the problem.

1. Rebooted the PC , switches and router (all at once and also individually).
2. Double checked the cat5 cable
3. Unplugged a couple of the cams in the 4 port switch thinking maybe data overload (also reduced the FPS for each cam)
4. Checked the 4 port switch power supply with a voltmeter, checks sat.
5. Using different ports on the 16 port switch
6. Extended IP reserve time to 12 hours

Thanks for any and all suggestions, hoping I am missing the obvious.

Shawn

1746559386345.png
 
Last edited:
Try gettings logs from the router and two switches, make sure their time is correct.
Check if you see anything in the logs around the time of the outage.
If you don't have logs, I would replace each time one component until the issue is eliminated.
I assume the issue is not with the cable, since if it was, I would expect it to fail always (for instance if critter damaged your cable).
Also, you can try other diagnostic tools, like: mtr or iperf3 to try to find the part that starts to fail.
Another option, is to setup Healthchecks.io – Cron Job Monitoring in each of the components (if possible, meaning, if you have SSH access or similar way), this way, when you have an outage, you may know which component is down.
 
  • Like
Reactions: Gimmons
Assuming that the cams are POE. Any of them outside?

1 - test each cable end to end connecting to the 4 port switch and to each cam with a network cable tester.
2 - try a different 4 port POE switch (guessing that is what they are). maybe the switch is over heating. Are the switches Gb or Mb? Managed?

On a managed switch you can typically see if the port is dropping packets or seeing errors.
 
There is nothing that sticks out as being wrong with your system. However the 4 port switch might be failing, or the POE power supply might be failing, etc. If the switch retains logs, there might be some clues as to what is going on. Otherwise I think I would simply replace that switch. Similar switches are not very expensive.
 
  • Like
Reactions: Broachoski, alastairstevenson and looney2ns

@d5775927​

@pete_c​

@The Automation Guy​

@looney2ns​

@AlwaysSomething​


Thanks for all of the speedy and helpful replies. I'll try to address all your comments in this post, which also made me think of another possible issue or two.

  • The switch(es) are unmanaged. The router log doesn't show anything useful.
  • The switch is a Netgear gigibit (G5305P) POE 63 watt device
  • The cable was replaced less than a year ago (simply due to a bad connector I didn't want to deal with).
  • I checked the cable yesterday, end to end, with a network cable tester. All good (and visually looks good).
  • All are POE cams and all are outside

Before I bought the switch, I did the math to make sure that the cams don't exceed the 63 watt rating, but after reading your comments I wonder if I am exceeding that value as I have swapped out a couple of cams since and did not take wattage into consideration? I'll start by looking at the suggested diagnostic tools, then replace the power supply and if that doesn't fix the problem I'll replace the switch (with a higher wattage rating).

It's great of you guys to help me out !

Shawn
 
  • Like
Reactions: pete_c and looney2ns
The fact that all cameras attached to the 4 port switch go out together says it's the switch. To test, switch one or more cameras on the 4 port with cameras on the other switch. See if the new camera(s) start going out. You could also replace the switch and see. They're ridiculously cheap.
 
Gimmons said:
The fact that all cameras attached to the 4 port switch go out together says it's the switch. To test, switch one or more cameras on the 4 port with cameras on the other switch. See if the new camera(s) start going out. You could also replace the switch and see. They're ridiculously cheap.
Click to expand...
Thanks for the help. I changed out the power supply a short time ago. If it fails again I'll replace the switch.
 
  • Like
Reactions: pete_c
You must log in or register to reply here.
Top Bottom