This would be nice to remove since we have a git submodule for PDF.js.
Something like this seems to work fine in both IceCat and Chromium:
<object width="400" height="500" type="application/pdf" data="file.pdf">
<p>PDF cannot be displayed.</p>
</object>