If you  use  variable bitrate compression, you normally see the highest bitrate at dusk and dawn, because the image is most noisy then and noise doesn't compress well.  During the night  the camera normally does more noise-reduction before compression, and during the day there's less noise to start with.  So something in your system is marginal and dropping some bits  during high-bitrate times; I assume either the network , CPU or disk.
 
	
