A Synthetic Prediction Market for Estimating Confidence in Published Work
Explainably estimating confidence in published scholarly work offers opportunity for faster and more robust scientific progress. We develop a synthetic prediction market to assess the credibility of published claims in the social and behavioral sciences literature. We demonstrate our system and detail our findings using a collection of known replication projects. We suggest that this work lays the foundation for a research agenda that creatively uses AI for peer review.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A prototype hybrid prediction market for estimating replicability of published work
We present a prototype hybrid prediction market and demonstrate the avenue it represents for meaningful human-AI collaboration. We build on prior work proposing artificial prediction markets as a novel machine-learning a…
PredictionEstimating Early Fundraising Performance of Innovations via Graph-based Market Environment Model
Well begun is half done. In the crowdfunding market, the early fundraising performance of the project is a concerned issue for both creators and platforms. However, estimating the early fundraising performance before the…
Human-AI Collaboration for Estimating Scientific Replicability
Determining whether published scientific findings can successfully be replicated is a long-standing challenge in the empirical sciences. Existing approaches for replicability assessment typically rely either on human jud…
Uncertainty quantification in automated valuation models with spatially weighted conformal prediction
Non-parametric machine learning models, such as random forests and gradient boosted trees, are frequently used to estimate house prices due to their predictive accuracy, but a main drawback of such methods is their limit…
Conformal PredictionUncertainty QuantificationEstimating Fund-Raising Performance for Start-up Projects from a Market Graph Perspective
In the online innovation market, the fund-raising performance of the start-up project is a concerning issue for creators, investors and platforms. Unfortunately, existing studies always focus on modeling the fund-raising…