Exciting News!

We are thrilled to launch our new grant program that will fund areas that we consider underexplored when it comes to AI safety.

In light of the potential for shorter AGI timelines, we will re-grant $1-1.2 million per year to support much-needed development.

Neurotechnology, Whole Brain Emulation, and Lo-fi uploading for AI Safety

We are interested in exploring the potential of neurotechnology, particularly Whole Brain Emulation (WBE) and cost-effective Lo-fi approaches to uploading, that could be significantly sped up, leading to a re-ordering of technology arrival that might reduce the risk of unaligned AGI by the presence of aligned software intelligence.

We are particularly excited by the following:

Neuroscience and neurotech approaches to AI Safety (e.g. BCI development for AI safety)
WBE as a potential technology that may generate software intelligence that is human-aligned simply by being based directly on human brains
Lo-fi approaches to uploading (e.g. extensive lifetime video of a laboratory mouse to train a model of a mouse without referring to biological brain data)
Other concrete approaches in this area
General scoping/mapping opportunities in this area, especially from a differential technology development perspective, as well as understanding the reasons why this area may not be a suitable focus

Cryptography and Security approaches for Infosec and AI Security

To explore the potential benefits of cryptography and security technologies in securing AI systems. This includes:

Computer security to help with AI infosecurity or approaches for scaling up security techniques to potentially apply to more advanced AI systems
Cryptographic and auxiliary techniques for building coordination/governance architectures across different AI(-building) entities
Privacy-preserving verification/evaluation techniques
Other concrete approaches in this area
General scoping/mapping opportunities in this area, especially from a differential technology development perspective, or exploring why this area is not a good focus area

Safe Multipolar AI Scenarios and Multi-Agent games

Exploring the potential of safe multipolar AI scenarios, such as:

Multi-agent game simulations or game theory
Scenarios avoiding collusion and deception, and pareto-preferred and positive-sum dynamics
Approaches for tackling principal agent problems in multipolar systems
Other concrete approaches in this area
General scoping/mapping opportunities in this area, especially from a differential technology development perspective, or exploring why this area is not a good focus area

Interested in Applying?

We hope you’re as excited as we are of this announcement, and we look forward to receiving your submissions. Applications will be reviewed on a rolling basis–be sure to apply today.

For the initial application, you’ll be required to submit:

A background of yourself and your work
A short summary and budget for your project highlighting which area you are applying to, and outlining what you would like to investigate and why
At least two references

We will aim to get back to applicants within 8 weeks of receiving their application.

If you are interested then please find more information about the grant here.

Are you a potential Funder?

We’re looking for additional funders so that we can support a larger number of impactful projects to ensure that we change the destiny of AI timelines – please reach out to us at [email protected] if this is something you would be excited about.

Donate and become part of our Community

As an active part of our community of talented scientists and technologists who expand the limit of our civilization’s capabilities, you will be at the forefront of our research, and our intriguing network.

Focus Area

Resources

Engage

Search Foresight Institute