Blog post: “Four LLM loss functions → four flavors of LLM misalignment” www.alignmentforum.org/posts/GRmvZs...
Who's Who of AI
Steve Byrnes
Why they matter
Researcher with public evidence across AI research, Culture, work & education.
- AI signals
- 7 past 30d
- Sources
- 2 distinct domains
- Discussions
- 1 past 30d
- Latest signal
- 2d ago
Researching Artificial General Intelligence Safety, via thinking about neuroscience and algorithms, at Astera Institute. https://sjbyrnes.com/agi.html
What they're sharing
Four LLM loss functions → four flavors of LLM misalignment — AI Alignment Forum alignmentforum.org
[Intro to brain-like-AGI safety] 2. “Learning from scratch” in the brain — AI Alignment Forum alignmentforum.org
RL & search is a terrifying way to build AGI (an FAQ) — AI Alignment Forum alignmentforum.org
LLMs are (still) mostly powered by imitative learning, not RL — LessWrong lesswrong.com
Foom & Doom 1: “Brain in a box in a basement” — AI Alignment Forum alignmentforum.org
Will almost all future companies eventually be founded and run by autonomous AIs? — LessWrong lesswrong.com
What do I mean by “Artificial General Intelligence”? — LessWrong lesswrong.com
Steve Byrnes’s Shortform — LessWrong lesswrong.com
Notes on technical alignment via human-like social drives — AI Alignment Forum alignmentforum.org
[Intro to brain-like-AGI safety] 6. Big picture of motivation, decision-making, and RL — LessWrong lesswrong.com
Sympathy for both sides of the egregious misalignment debate — AI Alignment Forum alignmentforum.org
Articles & links
I have lots of disagreements, mostly related to ↓ www.alignmentforum.org/posts/wBHSYw... (1/3)
Blog post: “RL & search is a terrifying way to build AGI (an FAQ)” www.alignmentforum.org/posts/KHyBoc... The FAQ has all your burning Q’s: Q1: What are you saying? Q2: So you’re saying, don’t build AGI based on RL and/or search & planning? Q3: Why do you think it’s terrifying…
Blog post: “LLMs are (still) mostly powered by imitative learning, not RL” www.lesswrong.com/posts/wYpjXR...
nah I’m more in the “sudden disempowerment” camp www.alignmentforum.org/posts/yew6zF...
Blog post: “Will almost all future companies eventually be founded and run by autonomous AIs?” I think this question is a great conversation-starter for people talking past each other on the future of AI. I go through some common responses, and my own replies (1/3) www.lesswro…
Blog post: What do I mean by “Artificial General Intelligence”? I paint a brief picture of what I’m talking about when I talk about “AGI”. Should seem obvious to many, and obviously wrong to many others! Hope it can help surface disagreements. www.lesswrong.com/posts/nQH2Gh...
Just updated the “Intro to Brain-Like-AGI Safety” PDF to version 4. Links in QT ↓ A few highlights from the changelog are listed here: www.lesswrong.com/posts/btHmC8...
Blog post: “Notes on technical alignment via human-like social drives” www.alignmentforum.org/posts/rKdS7i...
If someone is on a hunger strike for freedom, they’ll say that their desire to eat comes from their innate drives, whereas their desire to fight for freedom comes from “reason” etc. I think this intuition is very wrong; here’s my latest attempt to articulate why www.lesswrong.…
Blog post: “Sympathy for both sides of the egregious misalignment debate” www.alignmentforum.org/posts/DZaZ3f...
Their own posts
Recent commentary
I’ll probably annoy all sides with this not-really-an-apology that I just tacked onto the beginning of my LLM-skepticism-related post from Apr 2023
Their network
In Steve Byrnes's orbit
Center = Steve Byrnes. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.