The fix was easy, they though about it. Just need to add:
camera.software_auto_white_balance(True)
camera.software_auto_exposure(True)
Would be awesome to control them manually though. Also, the max gain is not high enough. My phone gives me way better result at night under few lamps than the arducam cameras.