The apps that control the light are to be used that way, with the light initially turned off. They’ll turn it on and off as needed.
You can also try Pharos, which sets the Inari Blue light to a lowest possible intensity, not spending much battery but enough to find the phone on your night stand while you sleep. Find your JP2 in the night - Constant mode (not pattern) for the Inari Blue LEDs - #5 by ric9k