Hi, your idea is correct, you only need to solder J25 and then you can only use the 5v power supply.
J17 is only the serial port that does not affect the power supply.