You maybe aren't closing the <audio> tag.
<audio... ></audio>
Whatever is in between the tags is shown on browsers that don't support the audio element, so if you don't close it, it's determining that the whole passage should only be shown if the element isn't supported.