Even when dimmed, the light given off from phone screens affects your eyes and will make it harder to focus on spotting stars in the dark.
Popping out your phone in the dark evening can be a mixed blessing, though, and is best kept limited as much as you can. Even when dimmed, the light given off from phone screens affects your eyes and will make it harder to focus on spotting stars in the dark.