Or is it only possible with the charger?
Should be the same voltage. The battery probably has a protective mechanism that can pass as well as nothing
Not without a charger in between
Simply with 5V on the LiIo battery with 3.7V rated voltage and 4.3V maximum? He will explode.