I like the sentiment, but there are non-peer reviewed papers that are real science. Politics and funding are real things, and there is a bit of gatekeeping here, which isn’t really good IMHO.

Also, reproducibility is a sticky subject, especially with immoral experiments (which can still be the product of science, however unsavory), or experiments for which there are only one apparatus in the world (e.g., some particle physics).

Imagine telling Yann LeCun what is and isn’t right when it comes to science