So I raised the issue of Day/Night settings for the IPC-Color4M-T to Andy (camera switching to Day settings just after the warm light is activated).
He said he forwarded it to Dahua.
In the meantime, I am back to Auto settings and it somehow works.
As advised, I compensated the weak warm light by an additional light (triggered my motion detection), but now the problem is that this light is lighting up quite soon, which makes the IPC-Color4M-T to think that it doesn't need to switch on the warm light (it is in Smart illumination mode). As the additional light is a bit farther, it means that people coming directly in front of the camera have the additional light behind them and no front illumination from the camera anymore (so the face is not really recognizable).
I looked in the camera settings, but it doesn't seem possible to force the warm light to light up in case of motion detection during the night ?
This warm light feature is nice but it is creating quite a number of issues...