Ai2

non-profit

Verified

https://allenai.org/

AI & ML interests

Building breatkthrough AI to solve the world's biggest problems.

Recent Activity

Ai2Comms published an article about 5 hours ago

StateBench: Testing how language models track state changes over long documents

Ai2Comms published a dataset about 5 hours ago

allenai/state-bench

chrisg-ai2 published a dataset about 19 hours ago

allenai/Dolci-Think-SFT-Clean-v2

View all activity

Papers

Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation

Learning to Solve Hard Problems in RL for LLMs by Never Giving Up

View all Papers

Articles

StateBench: Testing how language models track state changes over long documents

about 5 hours ago

Can we trust LLMs to judge whether a research idea is novel?

LitPivot: Developing research ideas through dynamic contextualization within the literature landscape

OlmoEarth v1.3: State-of-the-art embeddings for the whole planet

FairStress: A deeper evaluation of fairness in LLM decision-making

HiRO-ACEv2: Simulating extreme weather at 3 km resolution for a fraction of the cost

Impactful scheduling for GPU clusters

Open-sourcing AstaBrief, the fast report-generation model in Asta

Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

BenchMIRT: What are LLM benchmarks actually measuring?

Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis

TutorMoments: Do AI tutors know when to help and when to hold back?

The OlmoEarth Platform: Geospatial inference at planetary scale

What building Shippy taught us about building agents

DiScoFormer: One transformer for density and score, across distributions

Which tokens does a hybrid model predict better?

MolmoMotion: Language-guided 3D motion forecasting

olmo-eval: An evaluation workbench for the model development loop

OlmoEarth v1.1: A more efficient family of Earth observation models

EMO: Pretraining mixture of experts for emergent modularity

View all articles

Organization Card

Community About org cards

buckets 4

allenai/ai2cm-xshield

allenai/ai2cm-hosted-test

allenai/ACE2S-SHiELD-plus-reference-data

allenai/ai2-llm

Collections 57

View 57 collections

spaces 21

AstaBench Leaderboard

Explore AstaBench benchmark leaderboards

Molmo-Point Demo

MolmoPoint - Image & Video Pointing & Tracking

MolmoPoint-GUI Demo

MolmoPoint - GUI Image Pointing

Reward Bench Leaderboard

Explore RewardBench model rankings and datasets

HREF Leaderboard

Browse and search HREF leaderboard data

Zebra Logic Bench

Display model leaderboard and explore Zebra puzzle samples

models 981

allenai/OlmoEarth-v1_2-FT-LFMC-Base

Updated 8 days ago

allenai/HiRO-ACEv2

Updated 20 days ago • 6

allenai/Olmo-3.1-32B-Think

Text Generation • 32B • Updated 21 days ago • 6.92k • 119

allenai/OlmoEarth-v1_3-Base

Image Feature Extraction • Updated 21 days ago • 783 • 19

allenai/Bolmo-1B

Text Generation • 1B • Updated 27 days ago • 1.82k • 50

allenai/Bolmo-7B

Text Generation • 8B • Updated 27 days ago • 774 • 61

allenai/AstaBrief_8B

Text Generation • Updated Oct 3 • 2.37k • 70

allenai/AstaBrief_8B_SFT

Text Generation • Updated Oct 2 • 1.16k • 2

allenai/SamudrACE-E3SMv3

Updated Sep 24 • 78 • 4

allenai/ACE2S-SHiELD-plus

Updated Sep 10 • 40 • 5

View 981 models

datasets 1,298

allenai/Dolci-Think-SFT-Clean-v2

Viewer • Updated about 20 hours ago • 2.05M • 120 • 2

allenai/IFBench_test

Viewer • Updated 1 day ago • 300 • 16k • 17

allenai/asta-bench-submissions

Updated 2 days ago • 109 • 3

allenai/asta-summary-citation-counts

Viewer • Updated 2 days ago • 129M • 1.51k • 12

allenai/aimip-phase1-submissions

Viewer • Updated 4 days ago • 27 • 354

allenai/fairstress

Viewer • Updated 6 days ago • 13M • 951 • 7

allenai/olmoearth_pretrain_dataset

Preview • Updated 6 days ago • 4.24k • 21

allenai/asta-bench-results

Viewer • Updated 7 days ago • 102 • 891 • 1

allenai/XYBench-dataset

Updated 7 days ago • 32

allenai/Dolci-Think-SFT-Clean-v1

Viewer • Updated 8 days ago • 3.93M • 783 • 2

View 1,298 datasets