The purpose of a swipe/gesture-based interface is not to look cool, it is to allow imprecise interaction.
(Or rather not require needlessly precise interactions…) And you are asking for more finicky buttons?
For the particular use case of music players, you at least have lock screen controls that already have a back button.