Organizations Filed Purposes:
TO ENSURE THAT THE CREATION OF SMARTER-THAN-HUMAN INTELLIGENCE HAS A POSITIVE IMPACT. THUS, THE CHARITABLE PURPOSE OF THE ORGANIZATION IS TO: A) PERFORM RESEARCH RELEVANT TO ENSURING THAT SMARTER-THAN-HUMAN INTELLIGENCE HAS A POSITIVE IMPACT; B) RAISE AWARENESS OF THIS IMPORTANT ISSUE; C) ADVISE RESEARCHERS, LEASERS AND LAYPEOPLE AROUND THE WORLD; D) AS NECESSARY, IMPLEMENT A SMARTER-THAN-HUMAN INTELLIGENCE WITH HUMANE, STABLE GOALS.
TO ENSURE THAT THE CREATION OF SMARTER-THAN-HUMAN INTELLIGENCE HAS A POSITIVE IMPACT.
RESEARCH PROGRAM ACTIVITIES - WE SPENT THIS YEAR CONTINUING OUR EXISTING RESEARCH AGENDA AND EXPANDING WORK ON NEW RESEARCH DIRECTIONS. RESEARCH STAFF WERE PARTICULARLY ACTIVE IN POSTING TECHNICAL WRITEUPS ON OUR AI ALIGNMENT FORUM. OUR PROGRESS ON ALL OUR RESEARCH DIRECTIONS AND THE SUPPORTING INFRASTRUCTURE WAS STEADY AND SIGNIFICANT, IN LINE WITH OUR EXPECTATIONS. SIGNIFICANT RESEARCH PUBLICATIONS INCLUDE "DELEGATIVE REINFORCEMENT LEARNING: LEARNING TO AVOID TRAPS WITH A LITTLE HELP AND "RISKS FROM LEARNED OPTIMIZATION IN ADVANCED MACHINE LEARNING SYSTEMS"
OUTREACH - OUR OUTREACH ACTIVITIES THIS YEAR WERE FOCUSED ON RUNNING WORKSHOPS THAT EXPOSED AND ORIENTED TECHNICALLY MINDED PEOPLE TO AI RISK AND VARIOUS POTENTIAL PATHS FOR RESEARCH. WORKSHOPS WE HOSTED INCLUDED: AI RISK FOR COMPUTER SCIENTISTS, A FOUR-DAY WORKSHOP SERIES DESIGNED TO INTRODUCE TECHNICALLY MINDED PEOPLE TO THINKING TOOLS FOR REASONING ABOUT AI RISK; MIRI SUMMER FELLOWS, A TWO-WEEK RETREAT TO BRING PEOPLE UP TO SPEED ON PROBLEMS RELATED TO AI ALIGNMENT, TRAIN RESEARCH-RELEVANT SKILLS, AND INVESTIGATE OPEN PROBLEMS IN THE FIELD. OUTREACH PUBLICATIONS INCLUDE "ALIGNMENT RESEARCH FIELD GUIDE AND "AI SAFETY READING LIST". WE ATTENDED THE GLOBAL GOVERNANCE OF AI ROUNDTABLE EVENT.
Executives Listed on Filing
Total Salary includes financial earnings, benefits, and all related organization earnings listed on tax filing
| Name | Title | Hours Per Week | Total Salary |
|---|
| Edward Kmett | EMPLOYEE | 40 | $428,513 |
| Eliezer Yudkowsky | DIRECTOR/SECRETARY | 60 | $147,697 |
| Benya Fallenstein | EMPLOYEE | 40 | $144,000 |
| Colm O Riain | EMPLOYEE | 40 | $129,040 |
| Nicolas Tarleton | EMPLOYEE | 40 | $128,333 |
| Nate Soares | EXECUTIVE DIRECTOR | 60 | $128,290 |
| James Payor | EMPLOYEE | 40 | $124,500 |
| Malo Bourgon | COO/TREASURER | 60 | $98,138 |
| Blake Borgeson | DIRECTOR | 10 | $0 |
| Anna Salamon | DIRECTOR | 1 | $0 |
| Edwin Evans | CHAIRPERSON | 1 | $0 |
Data for this page was sourced from XML published by IRS (
public 990 form dataset) from:
https://s3.amazonaws.com/irs-form-990/202003219349318895_public.xml