Dualshock 4 will not hold charge

My dualshock 4 controller will “charge” as in the orange light come on, and if it remains on the charger it is fully functional but as soon as it is unplugged there is no response whatsoever. I have tried resetting the controller and even replacing the battery with a known working one but the problem persist. How can I fix this?