Yes I don't think I'm going to be defaulting it...
I think the issue might be that I configured it to switch between Day and Night profiles based on my schedule, but forgot to say "Force Color in day mode" and "Force BW in night mode" within each profile. I have not had time to check the settings yet though.