Connor Leahy on GPT3 and EleutherAI

In the first part of the podcast we chat about how to speed up GPT-3 training, how Conor updated on recent announcements of large language models, why GPT-3 is AGI for some specific definitions of AGI, the obstacles in plugging planning to GPT-N and why the brain might approximate something like backprop. We end this first chat with solomonoff priors, adversarial attacks such as Pascal Mugging, and whether direct work on AI Alignment is currently tractable. In the second part, we chat about his current projects at EleutherAI, multipolar scenarios and reasons to work on technical AI Alignment research.