arXiv is still running TeXlive 2016. The version that you can find in TeXlive 2019, biblatex 3.12, is incompatible with arXiv's version (biblatex 3.7).
The simplest solution is to install TeXlive 2017 (not TeXlive 2016, because arXiv switched to TeXlive 2016 when it was almost time to switch to TeXlive 2017, so their version of biblatex is the one in TeXlive 2017). You can get it from ftp://tug.org/historic/systems/texlive/
Once you do that, run the old pdflatex, then run the old biber, and send arXiv the .bbl file produced.
What is below is outdated but kept for posterity.
Update: As of February 10, 2017, arXiv has switched to TeX Live 2016. Hallelujah! It should now be possible to use biblatex when uploading to the arXiv (though this deserves a test).
Update 2: Having recently uploaded a paper to the arXiv, I can confirm it works without problems.
Starting with TeX Live 2016, no amount of tinkering was enough to get something that arXiv (which is still using TeXlive 2011) would accept.
Uploading all the needed files to arXiv is no longer an option. Indeed, the newest version of biblatex uses some macro from the package xstring that didn't exist in the 2011 version. The package xstring needs a file named xstring.tex. There is no way of telling arXiv that this isn't my main file (innocuously named "article.tex"), and so it tried to compile it. Obviously it didn't work.
This means that using biber is not an option, as the .bbl files produced by a new version of biber don't work with old version of biblatex. With TeXlive 2015 using the bibtex fallback worked, because bibtex was backwards-compatible enough that the .bbl files it produces worked with TeXlive 2011. This is no longer the case, as the produced .bbl file contains some macros that weren't present in the old TeXlive (I couldn't see all of them but the first that made the build fail was related to the sorting of entries).
My solution? I reinstalled the 5-years-old TeXlive 2011, ran the old version of pdflatex and then bibtex, and gave that .bbl file to arXiv.
The arXiv uses TeXlive 2011 and is in the process of upgrading to the 2015 version. This shouldn't really matter much unless you are using a package which was only made available after TeXlive 2011 so most likely, if it compiles fine on your computer, it should work fine on the arXiv.
When you begin a submission, they give you a few days to add the relevant files and fill in all the required information. During that time, you can make as many changes as you want.
It is only after you click the final Submit that it gets sent into the list for the next day's mailing list. After you have submitted the paper, you can make further changes to the paper until the deadline (though note that this modifies the submission time). Once the deadline has been reached, you can no longer modify your initial submission and further changes will start incrementing the version number of the paper.
Best Answer
Yes, there are ways to just upload the pdf without the source, but you should not do that because your impression that Overleaf can compile your file even though you have errors is wrong.
Overleaf (and indeed TeX) cannot compile your document properly if it has errors, Overleaf just shows you some document which might or might not be a valid pdf file. After an error, TeX only tries to recover enough to syntax check more of the file, it does not try to produce sensible output.
You should definitely fix the errors instead of trying to distribute what you think might be an acceptable pdf. This is only in your own interests. For example people using other pdf viewer than you might not be able to open your paper - you don't want to prevent anybody from reading your paper just because they cannot open it, do you?
Never ignore error messages with the argument that the output seems to look fine - it probably does not.