This is a transcript of Lex Fridman Podcast #387 with George Hotz.
The timestamps in the transcript are clickable links that take you directly to that point in
the main video. Please note that the transcript is human generated, and may have errors.
Here are some useful links:
- Go back to this episode’s main page
- Watch the full YouTube version of the podcast
Table of Contents
Here are the loose “chapters” in the conversation.
Click link to jump approximately to that part in the transcript:
- 0:00 – Introduction
- 1:39 – Time is an illusion
- 11:18 – Memes
- 13:55 – Eliezer Yudkowsky
- 26:19 – Virtual reality
- 32:38 – AI friends
- 40:03 – tiny corp
- 53:24 – NVIDIA vs AMD
- 56:21 – tinybox
- 1:08:30 – Self-driving
- 1:23:09 – Programming
- 1:31:06 – AI safety
- 1:56:03 – Working at Twitter
- 2:33:46 – Prompt engineering
- 2:39:42 – Video games
- 2:55:57 – Andrej Karpathy
- 3:06:02 – Meaning of life
Introduction
Lex Fridman
What possible ideas do you have for how human species ends?
George Hotz
Sure. I think the most obvious way to me is wire heading. We end up amusing ourselves to death. We end up all staring at that infinite TikTok and forgetting to eat. Maybe it’s even more benign than this. Maybe we all just stop reproducing. Now, to be fair, it’s probably hard to get all of humanity.
Lex Fridman
Yeah. The interesting thing about humanity is the diversity in it.
George Hotz
Oh, yeah.
Lex Fridman
Organisms in general. There’s a lot of weirdos out there, two of them are sitting here.
George Hotz
I mean, diversity in humanity is-
Lex Fridman
With due respect.
George Hotz
I wish I was more weird.
Lex Fridman
The following is a conversation with George Hotz, his third time on this podcast. He’s the founder of Comma.ai that seeks to solve autonomous driving and is the founder of a new company called tiny corp that created tinygrad, a neural network framework that is extremely simple with the goal of making it run on any device by any human easily and efficiently. As you know, George also did a large number of fun and amazing things from hacking the iPhone to recently joining Twitter for a bit as a “intern”, making the case for refactoring the Twitter code base.
In general he’s a fascinating engineer and human being, and one of my favorite people to talk to. This is a Lex Fridman podcast. To support it please check out our sponsors in the description. Now, dear friends, here’s George Hotz. You mentioned something in a stream about the philosophical nature of time. Let’s start with a wild question. Do you think time is an illusion?
Time is an illusion
George Hotz
You know, I sell phone calls to Comma for a thousand dollars and some guy called me. It’s a thousand dollars. You can talk to me for half an hour. He is like, “Yeah, okay. Time doesn’t exist and I really wanted to share this with you.” I’m like, “Oh, what do you mean time doesn’t exist?” I think time is a useful model, whether it exists or not. Right. Does quantum physics exist? Well, it doesn’t matter. It’s about whether it’s a useful model to describe reality. Is time maybe compressive?
Lex Fridman
Do you think there is an objective reality or is everything just useful models? Underneath it all is there an actual thing that we’re constructing models for?
George Hotz
I don’t know.
Lex Fridman
I was hoping you would know.
George Hotz
I don’t think it matters.
Lex Fridman
I mean, this connects to the models of constructive reality with machine learning, right?
George Hotz
Sure.
Lex Fridman
Is it just nice to have useful approximations of the world such that we can do something with it?
George Hotz
There are things that are real. [inaudible 00:02:57] complexity is real.
Lex Fridman
Yeah.
George Hotz
Yeah. The compressive-
Lex Fridman
Math.
George Hotz
Math is real. Yeah.
Lex Fridman
Should be a T-shirt.
George Hotz
I think hard things are actually hard. I don’t think P equals NP.
Lex Fridman
Ooh. Strong words.
George Hotz
Well, I think that’s the majority. I do think factoring is in P.
Lex Fridman
I don’t think you’re the person that follows the majority in all walks of life.
George Hotz
For that one I do
Lex Fridman
Yeah. In theoretical computer science, you’re one of the sheep. All right. To you time is a useful model.
George Hotz
Sure.
Lex Fridman
What were you talking about on the stream about time? Are you made of time?
George Hotz
If I remembered half the things I said on stream. Someday someone’s going to make a model of all of it and it’s going to come back to haunt me.
Lex Fridman
Someday soon?
George Hotz
Yeah, probably.
Lex Fridman
Would that be exciting to you or sad that there’s a George Hotz model?
George Hotz
I mean, the question is when the George Hotz model is better than George Hotz, like I am declining and the model is growing.
Lex Fridman
What is the metric by which you measure better or worse in that, if you are competing with yourself?
George Hotz
Maybe you can just play a game where you have the George Hotz answer and the George Hotz model answer and ask which people prefer.
Lex Fridman
People close to you or strangers?
George Hotz
Either one. It will hurt more when it’s people close to me, but both will be overtaken by the George Hotz model.
Lex Fridman
It’d be quite painful. Loved ones, family members would rather have the model over for Thanksgiving than you or significant others would rather sext with the large language model version of you.
George Hotz
Especially when it’s fine-tuned to their preferences.
Lex Fridman
Yeah. Well, that’s what we’re doing in a relationship. We’re just fine-tuning ourselves, but we’re inefficient with it because we’re selfish and greedy and so on. Language models can fine-tune more efficiently, more selflessly.
George Hotz
There’s a Star Trek Voyager episode where Kathryn Janeway lost in the delta quadrant makes herself a lover on the Holodeck, and the lover falls asleep on her arm and he snores a little bit. Janeway edits the program to remove that. Then of course the realization is, wait, this person’s terrible. It is actually all their nuances and quirks and slight annoyances that make this relationship worthwhile. I don’t think we’re going to realize that until it’s too late.
Lex Fridman
Well, I think a large language model could incorporate the flaws and the quirks and all that kind of stuff.
George Hotz
Just the perfect amount of quirks and flaws to make you charming without crossing the line.
Lex Fridman
Yeah, and that’s probably a good approximation of the percent of time the language model should be cranky or an asshole or jealous or all this kind of stuff.
George Hotz
Of course it can and it will. All that difficulty at that point is artificial. There’s no more real difficulty.
Lex Fridman
What’s the difference between real and artificial?
George Hotz
Artificial difficulty is difficulty that’s like constructed or could be turned off with a knob. Real difficulty is like you’re in the woods and you got to survive.
Lex Fridman
If something cannot be turned off with a knob it’s real?
George Hotz
Yeah, I think so. I mean, you can’t get out of this by smashing the knob with a hammer. I mean, maybe you can, Into the Wild when Alexander Supertramp, he wants to explore something that’s never been explored before, but it’s the nineties. Everything’s been explored. He’s like, “Well, I’m just not going to bring a map.”
Lex Fridman
Yeah.
George Hotz
I mean, no, you’re not exploring. You should have brought a map dude. You died. There was a bridge a mile from where you were camping.
Lex Fridman
How does that connect to the metaphor of the knob?
George Hotz
By not bringing the map, you didn’t become an explorer. You just smashed the thing.
Lex Fridman
Yeah.
George Hotz
Yeah. The difficulty is still artificial.
Lex Fridman
You failed before you started. What if we just don’t have access to the knob?
George Hotz
Well, that maybe is even scarier. We already exist in a world of nature, and nature has been fine-tuned over billions of years. To have humans build something and then throw the knob away in some grand romantic gesture is horrifying.
Lex Fridman
Do you think of us humans as individuals that are born and die or are we just all part of one living organism that is earth, that is nature?
George Hotz
I don’t think there’s a clear line there. I think it’s all kind of just fuzzy. I don’t know. I mean, I don’t think I’m conscious. I don’t think I’m anything. I think I’m just a computer program.
Lex Fridman
It’s all computation, everything running in your head is just computation.
George Hotz
Everything running in the universe is computation, I think. I believe the extended [inaudible 00:07:53] thesis.
Lex Fridman
There seems to be an embodiment to your particular computation. There’s a consistency.
George Hotz
Well, yeah, but I mean, models have consistency too.
Lex Fridman
Yeah.
George Hotz
Models that have been RLHF’d will continually say like, well, how do I murder ethnic minorities? Oh, well, I can’t let you do that, Hal. There’s a consistency to that behavior.
Lex Fridman
It’s all RLHF. We RLHF each other. We provide human feedback and thereby fine-tune these little pockets of computation. It’s still unclear why that pocket of computation stays with you for years. You have this consistent set of physics, biology, whatever you call the neurons firing like the electrical signals, the mechanical signals, all of that that seems to stay there. It contains information. It stores information, and that information permeates through time and stays with you. There’s like memory, there’s like sticky.
George Hotz
To be fair, a lot of the models we’re building today are very… Even RLHF is nowhere near as complex as the human loss function.
Lex Fridman
Reinforcement learning with human feedback.
George Hotz
When I talked about will GPT12 be AGI, my answer is no. Of course not. I mean, cross-entropy loss is never going to get you there. You need probably RL in fancy environments in order to get something that would be considered AGI-like. To ask the question about why? I don’t know. It’s just some quirk of evolution. I don’t think there’s anything particularly special about where I ended up, where humans ended up.
Lex Fridman
Okay, we have human level intelligence. Would you call that AGI, whatever we have, GI?
George Hotz
Look, actually, I don’t really even like the word AGI, but general intelligence is defined to be whatever humans have.
Lex Fridman
Okay, so why can GPT-12 not get us to AGI? Can we just linger on that?
George Hotz
If your loss function is categorical cross-entropy, if your loss function is just try to maximize compression. I have a SoundCloud I rap and I tried to get Chat-GPT to help me write raps and the raps that it wrote sounded like YouTube comment raps. You can go on any rap beat online and you can see what people put in the comments. It’s the most mid quality rap you can find.
Lex Fridman
Is mid good or bad?
George Hotz
Mid is bad.
Lex Fridman
Mid is bad.
George Hotz
It’s like mid.
Lex Fridman
Every time I talk to you, I learn new words. Mid.
George Hotz
Mid. Yeah.
Lex Fridman
I was like, is it like basic? Is that what mid means?
George Hotz
Kind of. It’s like middle of the curve, right?
Lex Fridman
Yeah.
George Hotz
There’s like that intelligence curve and you have the dumb guy, the smart guy, and then the mid guy. Actually being the mid guy is the worst. The smart guy is like I put all my money in Bitcoin. The mid guy is like, “You can’t put money in Bitcoin. It’s not real money.”
Lex Fridman
All of it is a genius meme. That’s another interesting one. Memes, the humor, the idea, the absurdity encapsulated in a single image and it just propagates virally between all of our brains. I didn’t get much sleep last night, so I sound like I’m high. I swear I’m not. Do you think we have ideas or ideas have us?
Memes
George Hotz
I think that we’re going to get super scary memes once the AIs actually are superhuman.
Lex Fridman
You think AI will generate memes?
George Hotz
Of course.
Lex Fridman
You think it’ll make humans laugh?
George Hotz
I think it’s worse than that. Infinite Jest, it’s introduced in the first 50 pages, is about a tape that once you watch it once you only ever want to watch that tape. In fact, you want to watch the tape so much that someone says, “Okay, here’s a hack saw. Cut off your pinky and then I’ll let you watch the tape again.” You’ll do it. We’re actually going to build that, I think, but it’s not going to be one static tape. I think the human brain is too complex to be stuck in one static tape like that. If you look at ant brains, maybe they can be stuck on a static tape, but we’re going to build that using generative models. We’re going to build the TikTok that you actually can’t look away from.
Lex Fridman
TikTok is already pretty close there, but the generation is done by humans. The algorithm is just doing their recommendation. If the algorithm is also able to do the generation.
George Hotz
Well, it’s a question about how much intelligence is behind it. The content is being generated by let’s say, one humanity worth of intelligence, and you can quantify a humanity, its exaflops, [inaudible 00:12:40], but you can quantify it. Once that generation is being done by a hundred humanities, you’re done.
Lex Fridman
It’s actually scale that’s the problem, but also speed. Yeah. What if it’s manipulating the very limited human dopamine engine, so porn? Imagine just TikTok, but for porn.
George Hotz
Yeah.
Lex Fridman
It’s like a brave new world.
George Hotz
I don’t even know what it’ll look like. Again, you can’t imagine the behaviors of something smarter than you, but a super intelligent, an agent that just dominates your intelligence so much will be able to completely manipulate you.
Lex Fridman
Is it possible that it won’t really manipulate? It’ll just move past us. It’ll just exist the way water exists or the air exists.
George Hotz
You see, and that’s the whole AI safety thing. It’s not the machine that’s going to do that. It’s other humans using the machine that are going to do that to you.
Lex Fridman
Because the machine is not interested in hurting humans. It’s just…
George Hotz
The machine is a machine, but the human gets the machine and there’s a lot of humans out there very interested in manipulating you.
Eliezer Yudkowsky
Lex Fridman
Well, let me bring up, Eliezer Yudkowsky who recently sat where you’re sitting. He thinks that AI will almost surely kill everyone. Do you agree with him or not?
George Hotz
Yes, but maybe for a different reason.
Lex Fridman
Then I’ll try to get you to find hope or we could find a note to that answer. But why yes?
George Hotz
Okay. Why didn’t nuclear weapons kill everyone?
Lex Fridman
That’s a good question.
George Hotz
I think there’s an answer. I think it’s actually very hard to deploy nuclear weapons tactically. It’s very hard to accomplish tactical objectives. Great. I can nuke their country. I have an irradiated pile of rubble. I don’t want that.
Lex Fridman
Why not?
George Hotz
Why don’t I want an irradiated pile of rubble?
Lex Fridman
Yeah.
George Hotz
For all the reasons no one wants an irradiated pile of rubble.
Lex Fridman
Oh, because you can’t use that land for resources. You can’t populate the land.
George Hotz
Yeah. Well, what you want, a total victory in a war is not usually the irradiation and eradication of the people there. It’s the subjugation and domination of the people.
Lex Fridman
Okay. You can’t use this strategically, tactically in a war to help gain a military advantage. It’s all complete destruction. All right.
George Hotz
Yeah.
Lex Fridman
There’s egos involved. It’s still surprising that nobody pressed the big red button.
George Hotz
It’s somewhat surprising. You see, it’s the little red button that’s going to be pressed with AI, and that’s why we die. It’s not because the AI, if there’s anything in the nature of AI, it’s just the nature of humanity.
Lex Fridman
What’s the algorithm behind the little red button? What possible ideas do you have for how human species ends?
George Hotz
Sure. I think the most obvious way to me is wire heading. We end up amusing ourselves to death. We end up all staring at that infinite TikTok and forgetting to eat. Maybe it’s even more benign than this. Maybe we all just stop reproducing. Now, to be fair, it’s probably hard to get all of humanity.
Lex Fridman
Yeah.
George Hotz
Yeah. It probably is.
Lex Fridman
The interesting thing about humanity is the diversity in it.
George Hotz
Oh yeah.
Lex Fridman
Organisms in general. There’s a lot of weirdos out there. Well, two of them are sitting here.
George Hotz
I mean, diversity in humanity is-
Lex Fridman
With due respect.
George Hotz
I wish I was more weird. No, look, I’m drinking Smart water, man. That’s like a Coca-Cola product, right?
Lex Fridman
You went corporate George Hotz.
George Hotz
Yeah, I went corporate. No, the amount of diversity and humanity I think is decreasing. Just like all the other biodiversity on the planet.
Lex Fridman
Oh boy. Yeah.
George Hotz
Right.
Lex Fridman
Social media’s not helping.
George Hotz
Go eat McDonald’s in China.
Lex Fridman
Yeah.
George Hotz
Yeah. No, it’s the interconnectedness that’s doing it.
Lex Fridman
Oh, that’s interesting. Everybody starts relying on the connectivity of the internet. Over time, that reduces the diversity, the intellectual diversity, and then that gets everybody into a funnel. There’s still going to be a guy in Texas.
George Hotz
There is.
Lex Fridman
And a bunker.
George Hotz
To be fair, do I think AI kills us all? I think AI kills everything we call society today. I do not think it actually kills the human species. I think that’s actually incredibly hard to do.
Lex Fridman
Yeah, but society, if we start over, that’s tricky. Most of us don’t know how to do most things.
George Hotz
Yeah, but some of us do, and they’ll be okay and they’ll rebuild after the great AI.
Lex Fridman
What’s rebuilding look like? How much do we lose? What has human civilization done that’s interesting? Combustion engine, electricity. So power and energy. That’s interesting. How to harness energy.
George Hotz
Whoa, whoa, whoa, whoa. They’re going to be religiously against that.
Lex Fridman
Are they going to get back to fire?
George Hotz
Sure. I mean, it’s be like some kind of Amish looking kind of thing. I think they’re going to have very strong taboos against technology.
Lex Fridman
Technology is almost like a new religion. Technology is the devil and nature is God.
George Hotz
Sure.
Lex Fridman
Closer to nature. Can you really get away from AI if it destroyed 99% of the human species, isn’t somehow have a hold like a stronghold?
George Hotz
Well, what’s interesting about everything we build, I think we’re going to build super intelligence before we build any sort of robustness in the AI. We cannot build an AI that is capable of going out into nature and surviving like a bird. A bird is an incredibly robust organism. We’ve built nothing like this. We haven’t built a machine that’s capable of reproducing.
Lex Fridman
I work with Lego robots a lot now. I have a bunch of them. They’re mobile. They can’t reproduce. All they need is, I guess you’re saying they can’t repair themselves. If you have a large number, if you have a hundred million of them-
George Hotz
Let’s just focus on them reproducing. Do they have microchips in them?
Lex Fridman
Mm-hmm (affirmative).
George Hotz
Okay. Then do they include a fab?
Lex Fridman
No.
George Hotz
Then how are they going to reproduce?
Lex Fridman
Well, it doesn’t have to be all on board. They can go to a factory, to a repair shop.
George Hotz
Yeah, but then you’re really moving away from robustness.
Lex Fridman
Yes.
George Hotz
All of life is capable of reproducing without needing to go to a repair shop. Life will continue to reproduce in the complete absence of civilization. Robots will not. If the AI apocalypse happens, I mean the AIs are going to probably die out because I think we’re going to get, again, super intelligence long before we get robustness.
Lex Fridman
What about if you just improve the fab to where you just have a 3D printer that can always help you?
George Hotz
Well, that’d be very interesting. I’m interested in building that.
Lex Fridman
Of course, you are. How difficult is that problem to have a robot that basically can build itself?
George Hotz
Very, very hard.
Lex Fridman
I think you’ve mentioned this to me or somewhere where people think it’s easy conceptually.
George Hotz
Then they remember that you’re going to have to have a fab.
Lex Fridman
Yeah, on board.
George Hotz
Of course.
Lex Fridman
3D printer that prints a 3D printer.
George Hotz
Yeah.
Lex Fridman
On legs. Why’s that hard?
George Hotz
Well, I mean, a 3D printer is a very simple machine, right? Okay, you’re going to print chips, you’re going to have an atomic printer. How are you going to dope the silicon?
Lex Fridman
Yeah.
George Hotz
Right. How you going to etch the silicon?
Lex Fridman
You’re going to have a very interesting kind of fab if you want to have a lot of computation on board. You can do structural type of robots that are dumb.
George Hotz
Yeah, but structural type of robots aren’t going to have the intelligence required to survive in any complex environment.
Lex Fridman
What about like ants type of systems? We have trillions of them.
George Hotz
I don’t think this works. I mean, again, ants at their very core are made up of cells that are capable of individually reproducing.
Lex Fridman
They’re doing quite a lot of computation that we’re taking for granted.
George Hotz
It’s not even just the computation. It’s that reproduction is so inherent. There’s two stacks of life in the world. There’s the biological stack and the silicon stack. The biological stack starts with reproduction. Reproduction is at the absolute core. The first proto-RNA organisms were capable of reproducing. The silicon stack, despite, as far as it’s come, is nowhere near being able to reproduce.
Lex Fridman
Yeah, So the fab movement, digital fabrication, fabrication in the full range of what that means is still in the early stages.
George Hotz
Yeah.
Lex Fridman
You’re interested in this world?
George Hotz
Even if you did put a fab on the machine, let’s say, okay, yeah, we can build fabs. We know how to do that as humanity. We can probably put all the precursors that build all the machines in the fabs also in the machine. First off, this machine’s going to be absolutely massive. I mean, we almost have a… Think of the size of the thing required to reproduce a machine today. Is our civilization capable of reproduction? Can we reproduce our civilization on Mars?
Lex Fridman
If we were to construct a machine that is made up of humans, like a company that can reproduce itself?
George Hotz
Yeah.
Lex Fridman
I don’t know. It feels like 115 people.
George Hotz
I think it’s so much harder than that.
Lex Fridman
120? I’m looking for a number.
George Hotz
Let’s see. I believe that Twitter can be run by 50 people. I think that this is going to take most of, it’s just most of society. We live in one globalized world now.
Lex Fridman
No, but you’re not interested in running Twitter, you’re interested in seeding. You want to seed a civilization and then because humans can like have sex.
George Hotz
Yeah. Okay. You’re talking about the humans reproducing and basically what’s the smallest self-sustaining colony of humans?
Lex Fridman
Yeah.
George Hotz
Yeah. Okay, fine but they’re not going to be making five nanometer chips.
Lex Fridman
Over time they will. We have to expand our conception of time here going back to the original timescale. I mean, over across maybe a hundred generations we’re back to making chips. No? If you seed the colony correctly.
George Hotz
Maybe, or maybe they’ll watch our colony die out over here and be like, “We’re not making chips. Don’t make chips.”
Lex Fridman
No, but you have to seed that colony correctly.
George Hotz
Whatever you do, don’t make chips. Chips are what led to their downfall.
Lex Fridman
Well, that is the thing that humans do. They construct a devil a good thing and a bad thing, and they really stick by that and then they murder each other over that. There’s always one asshole in the room who murders everybody and usually makes tattoos and nice branding with flags and stuff.
George Hotz
Do you need that asshole, that’s the question. Humanity works really hard today to get rid of that asshole, but I think they might be important.
Lex Fridman
Yeah. This whole freedom of speech thing, it’s the freedom of being an asshole seems kind of important.
George Hotz
That’s right.
Lex Fridman
Man. This thing, this fab, this human fab that we constructed, this human civilization is pretty interesting. Now it’s building artificial copies of itself or artificial copies of various aspects of itself that seem interesting like intelligence. I wonder where that goes.
George Hotz
I like to think it’s just another stack for life. We have the biostack life. We’re a biostack life, and then the silicon stack life.
Lex Fridman
It seems like the ceiling, or there might not be a ceiling, or at least the ceiling is much higher for the silicon stack.
George Hotz
Oh, no. We don’t know what the ceiling is for the biostack either. The biostack just seems to move slower. You have Moore’s law, which is not dead despite many proclamations.
Lex Fridman
In the biostack or the silicon stack?
George Hotz
In the silicon stack. You don’t have anything like this in the biostack. I have a meme that I posted. I tried to make a meme. It didn’t work too well, but I posted a picture of Ronald Reagan and Joe Biden, and you look, this is 1980 and this is 2020.
Lex Fridman
Yeah.
George Hotz
These two humans are basically the same, right? No, there’s been no change in humans in the last 40 years. Then I posted a computer from 1980 in a computer from 2020. Wow.
Lex Fridman
Yeah. With their early stages, which is why you said, when you said the size of the fab required to make another fab is very large right now.
George Hotz
Yeah.
Lex Fridman
Computers were very large 80 years ago, and they got pretty tiny and people are starting to want to wear them on their face in order to escape reality. That’s a thing. In order to live inside the computer, but a screen right here, I don’t have to see the rest of you assholes.
George Hotz
I’ve been ready for a long time.
Virtual reality
Lex Fridman
You like virtual reality?
George Hotz
I love it.
Lex Fridman
Do you want to live there?
George Hotz
Yeah.
Lex Fridman
Yeah. Part of me does too. How far away are we do you think?
George Hotz
Judging from what you can buy today? Far, very far.
Lex Fridman
I got to tell you that I had the experience of Meta’s Codec avatar where it’s a ultra-high resolution scan. It looked real.
George Hotz
I mean, the headsets just are not quite at eye resolution yet. I haven’t put on any headset where I’m like, “Oh, this could be the real world.” Whereas when I put good headphones on, audio is there. We can reproduce audio that I’m like, “I’m actually in a jungle right now. If I close my eyes, I can’t tell I’m not.”
Lex Fridman
Yeah. Then there’s also smell and all that kind of stuff.
George Hotz
Sure.
Lex Fridman
I don’t know. The power of imagination or the power of the mechanism in the human mind that fills the gaps that reaches and wants to make the thing you see in the virtual world real to you. I believe in that power.
George Hotz
Or humans want to believe.
Lex Fridman
Yeah. What if you’re lonely? What if you’re sad? What if you’re really struggling in life, and here’s a world where you don’t have to struggle anymore?
George Hotz
Humans want to believe so much that people think the large language models are conscious. That’s how much humans want to believe.
Lex Fridman
Strong words, he’s throwing left and right hooks. Why do you think large language models are not conscious?
George Hotz
I don’t think I’m conscious.
Lex Fridman
Oh, so what is consciousness then George Hotz?
George Hotz
It’s like what it seems to mean to people it’s just a word that atheists use for souls.
Lex Fridman
Sure. That doesn’t mean soul is not an interesting word.
George Hotz
If consciousness is a spectrum, I’m definitely way more conscious than the large language models are. I think the large language models are less conscious than a chicken.
Lex Fridman
When is the last time you’ve seen a chicken?
George Hotz
In Miami, a couple months ago.
Lex Fridman
No. A living chicken.
George Hotz
Just living chickens walking around Miami. It’s crazy.
Lex Fridman
Like on the street?
George Hotz
Yeah.
Lex Fridman
Like a chicken?
George Hotz
A chicken. Yeah.
Lex Fridman
All right. I was trying to call you out, like a good journalist, and I got shut down. Okay. You don’t think much about this subjective feeling that it feels like something to exist. Then as an observer, you can have a sense that an entity is not only intelligent, but has a subjective experience of its reality, like a self-awareness that is capable of suffering, of hurting, of being excited by the environment in a way that’s not merely an artificial response, but a deeply felt one.
George Hotz
Humans want to believe so much that if I took a rock and a Sharpie and drew a sad face on the rock, they’d think the rock is sad.
Lex Fridman
You’re saying when we look in the mirror, we apply the same smiley face with rock?
George Hotz
Pretty much, yeah.
Lex Fridman
Isn’t that weird though, that you’re not conscious?
George Hotz
No.
Lex Fridman
You do believe in consciousness?
George Hotz
Not really.
Lex Fridman
It’s unclear. Okay. To you it’s like a little symptom of the bigger thing that’s not that important.
George Hotz
Yeah. I mean, it’s interesting that the human systems seem to claim that they’re conscious, and I guess it says something in a straight up, even if you don’t believe in consciousness, what do people mean when they say consciousness? There’s definitely meanings to it.
Lex Fridman
What’s your favorite thing to eat?
George Hotz
Pizza.
Lex Fridman
Cheese pizza. What are the toppings?
George Hotz
I like cheese pizza. I like pepperoni.
Lex Fridman
Don’t say pineapple.
George Hotz
No, I don’t like pineapple.
Lex Fridman
Okay. Pepperoni pizza.
George Hotz
If they put any ham on it I’ll just feel bad.
Lex Fridman
What’s the best pizza? What are we talking about here? Do you like cheap, crappy pizza?
George Hotz
A Chicago deep dish cheese pizza. Oh, that’s my favorite.
Lex Fridman
There you go. You bite into a Chicago deep dish pizza, and it feels like, so you were starving, you haven’t eaten for 24 hours. You just bite in and you’re hanging out with somebody that matters a lot to you. You’re there with the pizza.
George Hotz
That sounds real nice, man.
Lex Fridman
Yeah. All right. It feels like something I’m George motherfucking Hotz eating a fucking Chicago deep dish pizza. There’s just the full peak living experience of being human, the top of the human condition.
George Hotz
Sure.
Lex Fridman
It feels like something to experience that.
George Hotz
Mm-hmm (affirmative).
Lex Fridman
Why does it feel like something? That’s consciousness, isn’t it?
George Hotz
If that’s the word you want to use to describe it. Sure. I’m not going to deny that that feeling exists. I’m not going to deny that I experienced that feeling. I guess what I take issue to is that there’s some like how does it feel to be a web server? Do 404s hurt?
Lex Fridman
Not yet.
George Hotz
How would you know what suffering looked like? Sure you can recognize a suffering dog because we’re the same stack as the dog. All the biostack stuff kind of, especially mammals. It’s really easy. You can…
Lex Fridman
Game recognizes game.
George Hotz
Yeah. Versus the silicon stack stuff it’s like, you have no idea. Wow the little thing has learned to mimic. Then I realized that that’s all we are too. Well, look, the little thing has learned to mimic.
Lex Fridman
Yeah. I guess, yeah. 404 could be suffering, but it’s so far from our kind-
Lex Fridman
… So far from our kind of living organism, our kind of stack. It feels like AI can start maybe mimicking the biological stack better, better, better. It’s trained.
George Hotz
We trained it, yeah.
Lex Fridman
In that, maybe that’s the definition of consciousness is the bio stack consciousness.
George Hotz
The definition of consciousness is how close something looks to human. Sure, I’ll give you that one.
Lex Fridman
No, how close something is to the human experience.
George Hotz
Sure. It’s a very anthropro-centric definition, but…
Lex Fridman
Well, that’s all we got.
AI friends
George Hotz
Sure. No. I think there’s a lot of value in it. Look, I just started my second company. My third company will be AI Girlfriends. I mean it.
Lex Fridman
I want to find out what your fourth company is after that.
George Hotz
Oh, wow.
Lex Fridman
I think once you have AI girlfriends, oh boy, does it get interesting. Well, maybe let’s go there. The relationships with AI, that’s creating human-like organisms. Part of being human is being conscious, is having the capacity to suffer, having the capacity to experience this life richly, in such a way that you can empathize, that AI system going to empathize with you, and you can empathize with it, or you can project your anthropomorphic sense of what the other entity is experiencing.
An AI model would need to create that experience inside your mind. It doesn’t seem that difficult.
George Hotz
Yeah. Okay, so here’s where it actually gets totally different. When you interact with another human, you can make some assumptions.
Lex Fridman
Yeah.
George Hotz
When you interact with these models, you can’t. You can make some assumptions that other human experiences suffering and pleasure in a pretty similar way to you do, the golden rule applies. With an AI model, this isn’t really true. These large language models are good at fooling people, because they were trained on a whole bunch of human data and told to mimic it.
Lex Fridman
Yep, but if the AI system says, “Hi, my name is Samantha,” it has a backstory. “Went to college here and there,” maybe it’ll integrate this in the AI system.
George Hotz
I made some chatbots. I gave them back stories. It was lots of fun. I’m so happy when Lama came out.
Lex Fridman
Yeah. Well, we’ll talk about Lama, we’ll talk about all that. The rock with a smiley face, it seems pretty natural for you to anthropomorphize that thing and then start dating it. Before you know it, you’re married and have kids
George Hotz
With a rock?
Lex Fridman
With a rock, and there’s pictures on Instagram with you and a rock and a smiley face.
George Hotz
To be fair, something that people generally look for when they’re looking for someone to date is intelligence in some form. The rock doesn’t really have intelligence. Only a pretty desperate person would date a rock.
Lex Fridman
I think we’re all desperate, deep down.
George Hotz
Oh, not rock level desperate.
Lex Fridman
All right. Not rock level desperate, but AI level desperate. I don’t know. I think all of us have a deep loneliness. It just feels like the language models are there.
George Hotz
Oh, I agree. You know what? I won’t even say this so cynically. I will actually say this in a way that I want AI friends. I do.
Lex Fridman
Yeah.
George Hotz
I would love to. Again, the language models now are still a little… People are impressed with these GPT things, or the Copilot, the coding one. I’m like, “Okay, this is junior engineer level, and these people are Fiverr level artists and copywriters.” Okay, great. We got Fiverr and junior engineers. Okay, cool. This is just the start, and it will get better, right? I can’t wait to have AI friends who are more intelligent than I am.
Lex Fridman
Fiverr is just a temporary, it’s not the ceiling?
George Hotz
No, definitely not.
Lex Fridman
Does it count as cheating when you’re talking to an AI model? Emotional cheating?
George Hotz
That’s up to you and your human partner to define.
Lex Fridman
Oh, you have to. All right.
George Hotz
You to have that conversation, I guess.
Lex Fridman
All right. Integrate that with porn and all this stuff.
George Hotz
Well, no, it’s similar kind of to porn.
Lex Fridman
Yeah.
George Hotz
Yeah. I think people in relationships have different views on that.
Lex Fridman
Yeah, but most people don’t have serious, open conversations about all the different aspects of what’s cool and what’s not. It feels like AI is a really weird conversation to have.
George Hotz
The porn one is a good branching off.
Lex Fridman
For sure.
George Hotz
One of my scenarios that I put in my chatbot is a nice girl named Lexi, she’s 20. She just moved out to LA. She wanted to be an actress, but she started doing Only Fans instead. You’re on a date with her. Enjoy.
Lex Fridman
Oh, man. Yeah. If you’re actually dating somebody in real life, is that cheating? I feel like it gets a little weird.
George Hotz
Sure.
Lex Fridman
It gets real weird. It’s like, what are you allowed to say to an AI bot? Imagine having that conversation with a significant other.
George Hotz
These are all things for people to define in their relationships. What it means to be human is just going to start to get weird.
Lex Fridman
Especially online. How do you know? There’ll be moments when you’ll have what you think is a real human you’re interacting with on Twitter for years, and you realize it’s not.
George Hotz
I spread, I love this meme, heaven banning. You hear about shadow-banning?
Lex Fridman
Yeah.
George Hotz
Right. Shadow-banning, okay, you post, no one can see it. Heaven banning, you post. No one can see it, but a whole lot of AIs are spot up to interact with you.
Lex Fridman
Well, maybe that’s what the way human civilization ends is all of us are heaven banned.
George Hotz
There’s a great, it’s called My Little Pony Friendship is optimal. It’s a sci-fi story that explores this idea.
Lex Fridman
Friendship is Optimal.
George Hotz
Friendship is Optimal.
Lex Fridman
Yeah. I’d like to have some, at least on the intellectual realm, some AI friends that argue with me. The romantic realm is weird, definitely weird, but not out of the realm of the kind of weirdness that human civilization is capable of, I think.
George Hotz
Look, I want it. If no one else wants it, I want it.
Lex Fridman
Yeah. I think a lot of people probably want it. There’s a deep loneliness.
George Hotz
I’ll fill their loneliness, and it just will only advertise to you some of the time.
Lex Fridman
Yeah. Maybe the conceptions of monogamy change too. I grew up in a time, I value monogamy, but maybe that’s a silly notion when you have arbitrary number of AI systems.
George Hotz
Yeah, on this interesting path from rationality to polyamory. Yeah. That doesn’t make sense for me,
Lex Fridman
For you, but you’re just a biological organism who was born before the internet really took off.
George Hotz
The crazy thing is, culture is whatever we define it as. These things are not… [inaudible 00:39:04] a problem and moral philosophy, right? Okay. What might be that computers are capable of mimicking girlfriends perfectly. They passed the girlfriend Turing test, but that doesn’t say anything about ought.
That doesn’t say anything about how we ought to respond to them as a civilization. That doesn’t say we ought to get rid of monogamy. Right. That’s a completely separate question, really, a religious one.
Lex Fridman
Girlfriend Turing test. I wonder what that looks like.
George Hotz
Girlfriend Turing test.
Lex Fridman
Are you writing that? Will you be the Alan Turing of the 21st century that writes the Girlfriend Turing test?
George Hotz
No, of course, my AI girlfriends, their goal is to pass the girlfriend Turing test.
Lex Fridman
No, but there should be a paper that kind of defines the test. The question is if it’s deeply personalized, or if there’s a common thing that really gets everybody.
George Hotz
Yeah. Look, we’re a company. We don’t have to get everybody. We just have to get a large enough clientele to stay with us.
tiny corp
Lex Fridman
I like how you’re already thinking company. All right. Before we go to company number three and company number four, let’s go to company number two.
George Hotz
All right.
Lex Fridman
Tiny Corp, possibly one of the greatest names of all time for a company. You’ve launched a new company called Tiny Corp that leads the development of Tinygrad. What’s the origin story of Tiny Corp and Tinygrad?
George Hotz
I started Tinygrad as a toy project, just to teach myself, okay, what is a convolution? What are all these options you can pass to them? What is the derivative of convolution? Very similar to Karpathy wrote Micrograd. I’m very similar. Then I started realizing, I started thinking about AI chips. I started thinking about chips that run AI. I was like, “Well, okay. This is going to be a really big problem. If Nvidia becomes a monopoly here, how long before Nvidia is nationalized?”
Lex Fridman
One of the reasons to start Tiny Corp is to challenge Nvidia.
George Hotz
It’s not so much to challenge Nvidia. Actually, I like Nvidia. It’s to make sure power stays decentralized.
Lex Fridman
Yeah. Here, it’s computational power. To you, Nvidia is kind of locking down the computational power of the world.
George Hotz
Nvidia becomes just like 10X better than everything else, you’re giving a big advantage to somebody who can secure Nvidia as a resource.
Lex Fridman
Yeah.
George Hotz
In fact, if Jensen watches this podcast, he may want to consider this. He may want to consider making sure his company’s not nationalized.
Lex Fridman
Do you think that’s an actual threat?
George Hotz
Oh, yes.
Lex Fridman
No, but there’s so much, there’s AMD.
George Hotz
We have Nvidia and AMD. Great.
Lex Fridman
All right. You don’t think there’s a push towards selling Google selling TPUs or something like this? You don’t think there’s a push for that?
George Hotz
Have you seen it? Google loves to rent you TPUs.
Lex Fridman
It doesn’t, you can’t buy it at Best Buy?
George Hotz
No.
Lex Fridman
Okay.
George Hotz
I started work on a chip. I was like, “Okay, what’s it going to take to make a chip?” My first notions were all completely wrong about why, about how you could improve on GPUs. I’ll take this, this is from Jim Keller on your podcast. This is one of my absolute favorite descriptions of computation. There’s three kinds of computation paradigms that are common in the world today.
There’s CPUs, and CPUs can do everything. CPUs can do add and multiply. They can do load and store, and they can do compare and branch. When I say they can do these things, they can do them all fast. Compare and branch are unique to CPUs. What I mean by they can do them fast is they can do things like branch prediction, and speculative execution, and they spend tons of transistors on these super deep reorder buffers in order to make these things fast.
Then you have a simpler computation model, GPUs. GPUs can’t really do compare and branch. They can, but it’s horrendously slow. GPUs can do arbitrary load and store. GPUs can do things like X, dereference Y, so they can fetch from arbitrary pieces of memory. They can fetch from memory that is defined by the contents of the data.
The third model of computation is DSPs. DSPs are just a and multiply. They can do loads and stores, but only static load and stores. Only loads and stores that are known before the program runs. You look at neural networks today, and 95% of neural networks are all the DSP paradigm. They are just statically scheduled adds and multiplies. Tiny Corp really took this idea, and I’m still working on it to extend this as far as possible, every stage of the stack has Turing completeness.
Python has Turing completeness, and then we take Python, we go into C++, which is Turing complete, and then maybe C++ calls into some CUDA kernels, which are Turing complete. The CUDA kernels go through LVM, which is Turing complete, into PTX, which is Turing complete, into SaaS, which is Turing complete, on a Turing complete processor. I want to get Turing completeness out of the stack entirely.
Once you get rid of Turing completeness, you can reason about things. Rice’s Theorem and the halting problem do not apply to [inaudible 00:44:20] machines.
Lex Fridman
Okay. What’s the power and the value of getting Turing completeness out of, are we talking about the hardware or the software?
George Hotz
Every layer of the stack.
Lex Fridman
Every layer.
George Hotz
Every layer of the stack. Removing Turing completeness allows you to reason about things. The reason you need to do branch prediction in a CPU, and the reason it’s prediction, and the branch predictors are, I think they’re like 99% on CPUs. Why do they get 1% of them wrong? Well, they get 1% wrong because you can’t know. That’s the halting problem. It’s equivalent to the halting problem to say whether a branch is going to be taken or not.
I can show that. The ADMO machine, the neural network runs the identical compute every time. The only thing that changes is the data. When you realize this, you think about, “Okay, how can we build a computer, and how can we build a stack that takes maximal advantage of this idea?”
What makes Tinygrad different from other neural network libraries is it does not have a primitive operator even for matrix multiplication. This is every single one. They even have primitive operators for things like convolutions.
Lex Fridman
No MatMul?
George Hotz
No MatMul. Well, here’s what a MatMul is. I’ll use my hands to talk here. If you think about a cube, and I put my two matrices that I’m multiplying on two faces of the cube, you can think about the matrix, multiply as, okay, the end cubed, I’m going to multiply for each one in the cubed. Then I’m going to do a sum, which is a reduce, up to here to the third phase of the cube. That’s your multiplied matrix.
What a matrix multiply is is a bunch of shape operations, a bunch of permute three shapes and expands on the two matrices, a multiply and cubed, a reduce and cubed, which gives you an N-squared matrix.
Lex Fridman
Okay. What is the minimum number of operations it can accomplish that if you don’t have MatMul as a primitive?
George Hotz
Tinygrad has about 20, and you can compare Tinygrad’s op set or IR to things like XLA or Prim Torch. XLA and Prim Torch are ideas where like, okay, Torch has like 2000 different kernels. PyTorch 2.0 introduced Prim Torch, which has only 250. Tinygrad has order of magnitude 25. It’s 10X less than XLA or Prim Torch. You can think about it as kind of RISC versus SISC, right? These other things are SISC-like systems. Tinygrad is RISC.
Lex Fridman
RISC won.
George Hotz
RISC architecture is going to change everything. 1995, Hackers.
Lex Fridman
Wait, really? That’s an actual thing?
George Hotz
Angelina Jolie delivers the line, “RISC architecture is going to change everything,” in 1995.
Lex Fridman
Wow.
George Hotz
Here we are with ARM and the phones and ARM everywhere.
Lex Fridman
Wow. I love it when movies actually have real things in them.
George Hotz
Right?
Lex Fridman
Okay, interesting. You’re thinking of this as the RISC architecture of ML Stack. 25, huh? Can you go through the four OP types?
George Hotz
Sure. Okay. You have unary ops, which take in a tensor and return a tensor of the same size, and do some unary op to it. X, log, reciprocal, sin. They take in one and they’re point-wise.
Lex Fridman
Relu.
George Hotz
Yeah, Relu. Almost all activation functions are unary ops. Some combinations of unary ops together is still a unary op. Then you have binary ops. Binary ops are like point-wise addition, multiplication, division, compare. It takes in two tensors of equal size, and outputs one tensor. Then you have reduce ops. Reduce ops will like take a three-dimensional tensor and turn it into a two-dimensional tensor, or a three-dimensional tensor, and turn into a zero dimensional tensor.
Think like a sum or a max are really common ones there. Then the fourth type is movement ops. Movement ops are different from the other types, because they don’t actually require computation. They require different ways to look at memory. That includes reshapes, permutes, expands, flips. Those are the main ones, probably.
Lex Fridman
With that, you have enough to make a MatMul?
George Hotz
And convolutions, and every convolution you can imagine, dilated convolutions, strided convolutions, transposed convolutions.
Lex Fridman
You’re right on GitHub about laziness, showing a MatMul, matrix multiplication. See how despite the style, it is fused into one kernel with the power of laziness. Can you elaborate on this power of laziness?
George Hotz
Sure. If you type in PyTorch, A times B plus C, what this is going to do is it’s going to first multiply A and B, and store that result into memory. Then it is going to add C by reading that result from memory, reading C from memory, and writing that out to memory.
There is way more loads in stores to memory than you need there. If you don’t actually do A times B as soon as you see it, if you wait until the user actually realizes that tensor, until the laziness actually resolves, you can fuse that plus C. It’s the same way Haskell works.
Lex Fridman
What’s the process of porting a model into Tinygrad?
George Hotz
Tinygrad’s front end looks very similar to PyTorch. I probably could make a perfect, or pretty close to perfect, interop layer if I really wanted to. I think that there’s some things that are nicer about Tinygrad’s syntax than PyTorch, but their front end looks very Torch-like. You can also load in ONNX models.
Lex Fridman
Okay.
George Hotz
We have more ONNX tests passing than Core ML.
Lex Fridman
Core ML. Okay.
George Hotz
We’ll pass ONNX run time soon.
Lex Fridman
Well, what about the developer experience with Tinygrad? What it feels like versus PyTorch?
George Hotz
By the way, I really like PyTorch. I think that it’s actually a very good piece of software. I think that they’ve made a few different trade-offs, and these different trade-offs are where Tinygrad takes a different path. One of the biggest differences is it’s really easy to see the kernels that are actually being sent to the GPU, right?
If you run PyTorch on a GPU, you do some operation, and you don’t know what kernels ran, you don’t know how many kernels ran. You don’t know how many flops were used. You don’t know how much memory accesses were used. Tinygrad type debug equals two, and it will show you in this beautiful style, every kernel that’s run, how many flops, and how many bites.
Lex Fridman
Can you just linger on what problem Tinygrad solves?
George Hotz
Tinygrad solves the problem of porting new ML accelerators quickly. One of the reasons, tons of these companies now, I think Sequoia marked Graphcore to zero, Cerebras, TensTorrent, Groq. All of these ML accelerator companies, they built chips. The chips were good, the software was terrible.
Part of the reason is because I think the same problem’s happening with Dojo. It’s really, really hard to write a PyTorch port, because you have to write 250 kernels, and you have to tune them all for performance.
Lex Fridman
What does Jim Keller think about Tinygrad? You guys hung out quite a bit. He was involved. He’s involved with TensTorrent.
George Hotz
Sure.
Lex Fridman
What’s his praise, and what’s his criticism of what you’re doing with your life?
George Hotz
Look, my prediction for TensTorrent is that they’re going to pivot to making risk five chips, CPUs.
Lex Fridman
CPUs.
George Hotz
Yeah.
Lex Fridman
Why?
George Hotz
Why? AI accelerators are a software problem, not really a hardware problem.
Lex Fridman
Oh, interesting. You think the diversity of AI accelerators in the hardware space is not going to be a thing that exists long term?
George Hotz
I think what’s going to happen is, okay. If you’re trying to make an AI accelerator, you better have the capability of writing a Torch-level performance stack on Nvidia GPUs. If you can’t write a Torch stack on Nvidia GPUs and I mean all the way, I mean down to the driver, there’s no way you’re going to be able to write it on your chip. Your chip’s worse than in Nvidia GPU. The first version of the chip you tape out, it’s definitely worse.
Lex Fridman
Oh, you’re saying writing that stack is really tough?
George Hotz
Yes, and not only that, actually the chip that you tape out, almost always, because you’re trying to get advantage over Nvidia, you’re specializing the hardware more. It’s always harder to write software for more specialized hardware. A GPU is pretty generic. If you can’t write an in Nvidia stack, there’s no way you can write a stack for your chip. My approach with Tinygrad is first write a performant NVIDIA stack. We’re targeting AMD.
Lex Fridman
You did say FU to Nvidia a little bit with Love.
George Hotz
With love. Yeah, with love. It’s like the Yankees. I’m a Mets fan.
NVIDIA vs AMD
Lex Fridman
Oh, you’re a Mets fan? A RISC fan and a Mets fan. What’s the hope that AMD has? You did a build with AMD recently that I saw. How does the 7,900 XTX compare to the RTX 4090 or 4080?
George Hotz
Oh, well, let’s start with the fact that the 7,900 XTX kernel drivers don’t work. If you run demo apps and loops, it panics the kernel.
Lex Fridman
Okay, so this is a software issue.
George Hotz
Lisa Sue responded to my email.
Lex Fridman
Oh.
George Hotz
I reached out. I was like, “This is, really?”
Lex Fridman
Yeah.
George Hotz
I understand if your seven by seven transposed Winograd comp is slower than NVIDIA’s, but literally when I run demo apps in a loop, the kernel panics?
Lex Fridman
Just adding that loop?
George Hotz
Yeah. I just literally took their demo apps and wrote, “While true; do the app; done,” in a bunch of screens. This is the most primitive fuzz testing.
Lex Fridman
Why do you think that is? They’re just not seeing a market in machine learning?
George Hotz
They’re changing. They’re trying to change. They’re trying to change. I had a pretty positive interaction with them this week. Last week, I went on YouTube. I was just like, “That’s it. I give up on AMD. Their driver doesn’t even… I’ll go with Intel GPUs. Intel GPUs have better drivers.”
Lex Fridman
You’re kind of spearheading the diversification of GPUs.
George Hotz
Yeah, and I’d like to extend that diversification to everything. I’d like to diversify, the more my central thesis about the world is there’s things that centralize power, and they’re bad. There’s things that decentralize power, and they’re good. Everything I can do to help decentralize power, I’d like to do.
Lex Fridman
You’re really worried about the centralization of Nvidia. That’s interesting. You don’t have a fundamental hope for the proliferation of ASICs except in the cloud?
George Hotz
I’d like to help them with software. No, actually, the only ASIC that is remotely successful is Google’s TPU. The only reason that’s successful is because Google wrote a machine learning framework. I think that you have to write a competitive machine learning framework in order to be able to build an ASIC.
Lex Fridman
You think Meta with PyTorch builds a competitor?
George Hotz
I hope so.
Lex Fridman
Okay.
George Hotz
They have one. They have an internal one.
Lex Fridman
Internal, I mean public facing with a nice cloud interface and so on?
George Hotz
I don’t want a cloud.
Lex Fridman
You don’t like cloud?
George Hotz
I don’t like cloud.
Lex Fridman
What do you think is the fundamental limitation of cloud?
George Hotz
Fundamental limitation of cloud is who owns the off switch.
Lex Fridman
That’s the power to the people.
George Hotz
Yeah.
Lex Fridman
You don’t like the man to have all the power.
George Hotz
Exactly.
tinybox
Lex Fridman
All right. Right now, the only way to do that is with Nvidia GPUs if you want performance and stability. Interesting. It’s a costly investment emotionally to go with AMD’s. Well, let me on a tangent, ask you, you’ve built quite a few PCs. What’s your advice on how to build a good custom PC for, let’s say, for the different applications that you use for gaming, for machine learning?
George Hotz
Well, you shouldn’t build one. You should buy a box from the Tiny Corp.
Lex Fridman
I heard rumors, whispers about this box in the Tiny Corp. What’s this thing look like? What is it called?
George Hotz
It’s called the Tinybox.
Lex Fridman
Tinybox.
George Hotz
It’s $15,000, and it’s almost a paid flop of compute. It’s over a hundred gigabytes of GPU RAM. It’s over five terabytes per second of GPU memory bandwidth. I’m going to put four NVMes in RAID. You’re going to get like 20, 30 gigabytes per second of drive read bandwidth. I’m going to build the best deep learning box that I can plugs into one wall outlet.
Lex Fridman
Okay. Can you go through those specs again a little bit from memory?
George Hotz
Yeah. It’s almost a paid flop of compute.
Lex Fridman
AMD, Intel?
George Hotz
Today I’m leaning toward AMD, but we’re pretty agnostic to the type of compute. The main limiting spec is a 120 volt, 15 amp circuit.
Lex Fridman
Okay.
George Hotz
Well, I mean it. In order to, there’s a plug over there. You have to be able to plug it in. We’re also going to sell the Tiny Rack, which, what’s the most power you can get into your house without arousing suspicion? One of the answers is an electric car charger.
Lex Fridman
Wait, where does the Rack go?
George Hotz
Your garage.
Lex Fridman
Interesting. The car charger?
George Hotz
A wall outlet is about 1500 watts. A car charger is about 10,000 watts.
Lex Fridman
Okay. What is the most amount of power you can get your hands on without arousing suspicion?
George Hotz
That’s right.
Lex Fridman
George Hotz. Okay. The Tinybox, and you said NVMEs in RAID. I forget what you said about memory, all that kind of stuff. Okay, so what about with GPUs?
George Hotz
Again, probably-
Lex Fridman
Agnostic.
George Hotz
Probably 7,900 XTXes, but maybe 3090s, maybe A770s. Those are Intel’s.
Lex Fridman
You’re flexible, or still exploring?
George Hotz
I’m still exploring. I want to deliver a really good experience to people. What GPUs I end up going with, again, I’m leaning toward AMD. We’ll see. In my email, what I said to AMD is, “Just dumping the code on GitHub is not open source. Open source is a culture. Open source means that your issues are not all one year old, stale issues. Open source means developing in public. If you guys can commit to that, I see a real future for AMD as a competitor to Nvidia.”
Lex Fridman
Well, I’d love to get a Tinybox to MIT. Whenever it’s ready-
George Hotz
Will do.
Lex Fridman
Let’s do it.
George Hotz
We’re taking pre-orders. I took this from Elon. I’m like, “$100, fully refundable pre-orders.”
Lex Fridman
Is it going to be like the cyber truck? It’s going to take a few years?
George Hotz
No, I’ll try to do it faster. It’s a lot simpler. It’s a lot simpler than a truck.
Lex Fridman
Well, there’s complexities, not to just the putting the thing together, but shipping it, all this kind of stuff.
George Hotz
The thing that I want to deliver to people out of the box is being able to run 65 billion parameter Lama in FP16 in real time, in a good 10 tokens per second, or five tokens per second or something.
Lex Fridman
Just, it works.
George Hotz
Yep, just works.
Lex Fridman
Lama’s running, or something like Lama.
George Hotz
Yeah, or I think Falcon is the new one. Experience a chat with the largest language model that you can have in your house.
Lex Fridman
Yeah, from a wall plug.
George Hotz
From a wall plug, yeah. Actually, for inference, it’s not like even more power would help you get more.
Lex Fridman
Even more power wouldn’t get you more.
George Hotz
Well, no, the biggest model released is 65 billion parameter Lama, as far as I know.
Lex Fridman
It sounds like Tinybox will naturally pivot towards company number three. You could just get the girlfriend or boyfriend.
George Hotz
That one’s harder, actually.
Lex Fridman
The boyfriend is harder?
George Hotz
The boyfriend’s harder, yeah.
Lex Fridman
I think that’s a very biased statement.
George Hotz
No.
Lex Fridman
I think a lot of people disagree. Why is it harder to replace a boyfriend than a girlfriend with the artificial LLM?
George Hotz
Women are attracted to status and power, and men are attracted to youth and beauty. No, this is what I mean.
Lex Fridman
Both could be mimic-able easy through the language model.
George Hotz
No. No, machines do not have any status or real power.
Lex Fridman
I don’t know. Well, first of all, you’re using language mostly to communicate youth and beauty and power and status.
George Hotz
Sure, but status fundamentally is a zero-sum game, whereas youth and beauty are not.
Lex Fridman
No, I think status is a narrative you can construct. I don’t think status is real.
George Hotz
I don’t know. I just think that that’s why it’s harder. Yeah, maybe it is my biases.
Lex Fridman
I think status is way easier to fake.
George Hotz
I also think that men are probably more desperate and more likely to buy my product. Maybe they’re a better target market.
Lex Fridman
Desperation is interesting. Easier to fool.
George Hotz
Yeah.
Lex Fridman
I could see that.
George Hotz
Yeah. Look, I know you can look at porn viewership numbers, right? A lot more men watch porn than women.
Lex Fridman
Yeah.
George Hotz
You can ask why that is.
Lex Fridman
Wow. There’s a lot of questions and answers you can get there. Anyway, with the Tinybox, how many GPUs in Tinybox?
George Hotz
Six.
Lex Fridman
Oh, man.
George Hotz
I’ll tell you why it’s six.
Lex Fridman
Yeah.
George Hotz
AMD Epic processors have 128 lanes of PCIE. I want to leave enough lanes for some drives, and I want to leave enough lanes for some networking.
Lex Fridman
How do you do cooling for something like this?
George Hotz
Ah, that’s one of the big challenges. Not only do I want the cooling to be good, I want it to be quiet.
Lex Fridman
Yeah.
George Hotz
I want the Tinybox to be able to sit comfortably in your room. Right.
Lex Fridman
This is really going towards the girlfriend thing. You want to run the LLM-
George Hotz
I’ll give a more, I can talk about how it relates to company number one.
Lex Fridman
Come AI.
George Hotz
Yeah.
Lex Fridman
Well, but yes, quiet. Oh, quiet because you maybe potentially want to run it in a car?
George Hotz
No, no. Quiet because you want to put this thing in your house. You want it to coexist with you. If it’s screaming at 60 dB, you don’t want that in your house. You’ll kick it out.
Lex Fridman
60 dB, yeah.
George Hotz
Yeah. I want like 40, 45.
Lex Fridman
How do you make the cooling quiet? That’s an interesting problem in itself.
George Hotz
A key trick is to actually make it big. Ironically, it’s called the Tinybox, but if I can make it big, a lot of that noise is generated because of high pressure air. If you look at a 1U server, a 1U server has these super high pressure fans.
They’re super deep and they’re like jet engines, versus if you have something that’s big, well, I can use a big, they call them big ass fans. Those ones that are huge on the ceiling? They’re completely silent.
Lex Fridman
Tinybox will be big.
George Hotz
I do not want it to be large according to UPS. I want it to be shippable as a normal package, but that’s my constraint there.
Lex Fridman
Interesting. Well, the fan stuff, can it be assembled on location, or no?
George Hotz
No.
Lex Fridman
No, it has to be… Well, you’re…
George Hotz
Look, I want to give you a great out of the box experience. I want you to lift this thing out, I want it to be like the Mac, Tinybox.
Lex Fridman
The Apple experience.
George Hotz
Yeah.
Lex Fridman
I love it. Okay. Tinybox would run Tinygrad. What do you envision this whole thing to look like? We’re talking about Linux with a full…
Lex Fridman
Linux with a full software engineering environment and it’s just not PyTorch, but tinygrad.
George Hotz
Yeah, we did a poll. If people want Ubuntu or Arch, we’re going to stick with Ubuntu.
Lex Fridman
Interesting. What’s your favorite flavor of Linux?
George Hotz
Ubuntu.
Lex Fridman
Ubuntu. I like Ubuntu MATE, however you pronounce that MATE. You’ve gotten LLaMA into tinygrad, you’ve gotten stable diffusion into tinygrad. What was that like? What are these models, what’s interesting about porting them? What are the challenges? What’s naturally? What’s easy? All that kind of stuff.
George Hotz
There’s a really simple way to get these models into tinygrad and you can just export them as Onyx and then tinygrad can run Onyx. So the ports that I did of LLaMA Stable Diffusion and now Whisper are more academic to teach me about the models, but they are cleaner than the PyTorch versions. You can read the code. I think the code is easier to read, it’s less lines. There’s just a few things about the way tinygrad writes things. Here’s a complaint I have about PyTorch. nn.ReLU is a class so when you create an NN module, you’ll put your nn ReLUs as in a nit, and this makes no sense. ReLU is completely stateless. Why should that be a class?
Lex Fridman
But that’s more a software engineering thing, or do you think it has a cost on performance?
George Hotz
Oh no, it doesn’t have a cost on performance, but yeah, no. That’s what I mean about tinygrad’s front end being cleaner.
Lex Fridman
I see. What do you think about Mojo? I don’t know if you’ve been paying attention, the programming language that does some interesting ideas that intersect tinygrad.
George Hotz
I think that there’s a spectrum and on one side you have Mojo and on the other side you have ggml. Ggml is this like, we’re going to run LlaMA fast on Mac. Okay. We’re going to expand out to a little bit, but we’re going to basically depth first, right? Mojo is like we’re going to go breath first. We’re going to go so wide that we’re going to make all of Python Fast and tinygrad’s in the middle. Tinygrads, we are going to make neural networks fast,
Lex Fridman
But they try to really get it to be fast, compile down to the specifics hardware and make that compilation step as flexible and resilient as possible.
George Hotz
But they’ve turned completeness.
Lex Fridman
And that limits you? That’s what you’re saying it’s somewhere in the middle. So you’re actually going to be targeting some accelerators, some number, not one.
George Hotz
My goal is step one, build an equally performance stack to PyTorch on Nvidia and AMD, but with way less lines. And then step two is, okay, how do we make an accelerator? But you need step one. You have to first build the framework before you can build the accelerator.
Lex Fridman
Can you explain MLPerf? What’s your approach in general to benchmarking tinygrad performance?
George Hotz
I’m much more of a build it the right way and worry about performance later. There’s a bunch of things where I haven’t even really dove into performance. The only place where tinygrad is competitive performance wise right now is on Qualcomm GPUs. So tinygrads actually used an openpilot to run the model. So the driving model is tinygrad.
Lex Fridman
When did that happen? That transition?
George Hotz
About eight months ago now. And it’s two x faster than Qualcomm’s library.
Lex Fridman
What’s the hardware of that openpilot runs on the comma.ai?
George Hotz
It’s a Snapdragon 845.
Lex Fridman
Okay.
George Hotz
So this is using the GPU. So the GPU’s in Adreno GPU. There’s different things. There’s a really good Microsoft paper that talks about mobile GPUs and why they’re different from desktop GPUs. One of the big things is in a desktop GPU, you can use buffers. On a mobile GPU image textures are a lot faster
Lex Fridman
On a mobile GPU image textures. Okay. And so you want to be able to leverage that?
George Hotz
I want to be able to leverage it in a way that it’s completely generic. So there’s a lot of… Xiaomi has a pretty good open source library for mobile GPUs called MACE where they can generate where they have these kernels, but they’re all hand coded. So that’s great. If you’re doing three by three comps, that’s great if you’re doing dense mat malls, but the minute you go off the beaten path a tiny bit, well your performance is nothing.
Self-driving
Lex Fridman
Since you mentioned openpilot, I’d love to get an update in the company number one, comma.ai world. How are things going there in the development of semi autonomous driving?
George Hotz
Almost no one talks about FSD anymore and even less people talk about openpilot. We’ve thought the problem, we solved it years ago.
Lex Fridman
What’s the problem exactly? What does solving it mean?
George Hotz
Solving means how do you build a model that outputs a human policy for driving. How do you build a model that given reasonable set of sensors, outputs a human policy for driving? So you have companies like [inaudible 01:09:15], which are hand coding, these things that are quasi human policies. Then you have Tesla and maybe even to more of an extent, comma, asking, okay, how do we just learn the human policy and data? The big thing that we’re doing now, and we just put it out on Twitter. At the beginning of comma, we published a paper called Learning a Driving Simulator. And the way this thing worked was, it was an auto encoder and then an RNN in the middle. You take an auto encoder, you compress the picture, you use an RNN, predict the next date. It was a laughably bad simulator. This is 2015 error machine learning technology. Today we have VQVAE and transformers. We’re building drive GPT basically.
Lex Fridman
Drive GPT. Okay. And it’s trained on what? Is it trained in a self supervised way?
George Hotz
Yeah. It’s trained on all the driving data to predict the next frame.
Lex Fridman
So really trying to learn a human policy. What would a human do?
George Hotz
Actually our simulator’s conditioned on the pose. So it’s actually a simulator. You can put in a state action pair and get out the next state. And then once you have a simulator, you can do RRL in the simulator and RRL will get us that human policy.
Lex Fridman
So transfers?
George Hotz
Yeah. RRL with a reward function. Not asking is this close to the human policy, but asking would a human disengage if you did this behavior?
Lex Fridman
Okay, let me think about the distinction there. What a human disengage. That correlates, I guess with human policy, but it could be different. So it doesn’t just say, what would a human do? It says what would a good human driver do and such that the experience is comfortable but also not annoying in that the thing is very cautious. So it’s finding a nice balance. That’s interesting. That’s a nice-
George Hotz
It’s asking exactly the right question. What will make our customers happy? A system that you never want to disengage.
Lex Fridman
Because usually disengagement is this almost always a sign of I’m not happy with what the system is doing.
George Hotz
Usually. There’s some that are just, I felt like driving and those are always fine too, but they’re just going to look like noise in the data.
Lex Fridman
But even I felt like driving.
George Hotz
Maybe. Yeah.
Lex Fridman
That’s a signal. Why do you feel like driving. You need to recalibrate your relationship with the car. Okay, so that’s really interesting. How close are we to solving self driving?
George Hotz
It’s hard to say. We haven’t completely closed the loop yet. So we don’t have anything built that truly looks like that architecture yet. We have prototypes and there’s bugs. So we are a couple bug fixes away. Might take a year, might take 10.
Lex Fridman
What’s the nature of the bugs? Are these major philosophical bugs? Logical bugs? What kind of bugs are we talking about?
George Hotz
They’re just stupid bugs. And also we might just need more scale. We just massively expanded our compute cluster at comma. We now have about two people worth of compute. 40 petaflops.
Lex Fridman
Well, people are different.
George Hotz
20 petaflops. That’s a person. It’s just a unit. Horses are different too, but we still call it a horsepower.
Lex Fridman
But there’s something different about mobility than there is about perception and action in a very complicated world. But yes.
George Hotz
Yeah. Of course not all flops are created equal. If you have randomly initialized weights, it’s not going to…
Lex Fridman
Not all flops are created equal.
George Hotz
For some flops are doing way more useful things than others.
Lex Fridman
Yep. Tell me about it. Okay, so more data. Scale means more scale in compute or scale in scale of data.
George Hotz
Both.
Lex Fridman
Diversity of data.
George Hotz
Diversity is very important in data. Yeah. I think we have 5,000 daily actives.
Lex Fridman
How would you evaluate? How FSD doing with self-driving.
George Hotz
Pretty well.
Lex Fridman
How’s that race going between Comma.ai and FSD?
George Hotz
Tesla has always wanted to two years ahead of us. They’ve always been one to two years ahead of us and they probably always will be because they’re not doing anything wrong.
Lex Fridman
What have you seen since the last time we talked that are interesting architectural decisions, training decisions the way they deploy stuff, the architectures they’re using in terms of the software, how the teams are run, all that kind of stuff, data collection, anything interesting?
George Hotz
I know they’re moving toward more of an end-to-end approach.
Lex Fridman
So creeping towards end-to- end as much as possible across the whole thing? The training, the data collection, and everything?
George Hotz
They also have a very fancy simulator. They’re probably saying all the same things we are. They’re probably saying we just need to optimize. What is the reward? Well, you get negative reward for disengagement. Everyone knows this. It’s just a question who can actually build and deploy the system?
Lex Fridman
Yeah. This requires good software engineering, I think. And the right kind of hardware.
George Hotz
Yeah. And the hardware to run it.
Lex Fridman
You still don’t believe in cloud in that regard?
George Hotz
I have a compute cluster in my office, 800 amps,
Lex Fridman
tinygrad.
George Hotz
It’s 40 kilowatts at idle our data center. That seem crazy. Have 40 kilowatts is burning just when the computers are idle. Sorry. Compute cluster.
Lex Fridman
Compute cluster. I got it.
George Hotz
It’s not a data center. Data centers are clouds. We don’t have clouds. Data centers have air conditioners. We have fans that makes it a compute cluster.
Lex Fridman
I’m guessing this is a kind of legal distinction that should [inaudible 01:15:03].
George Hotz
Sure. Yeah. We have a compute cluster.
Lex Fridman
You said that you don’t think LLMs have consciousness, or at least not more than a chicken. Do you think they can reason? Is there something interesting to you about the word reason about some of the capabilities that we think is kind of human to be able to integrate complicated information and through a chain of thought arrive at a conclusion that feels novel? A novel integration of disparate facts?
George Hotz
Yeah. I don’t think that they can reason better than a lot of people.
Lex Fridman
Yeah. Isn’t that amazing to you though? Isn’t that an incredible thing that a transformer can achieve?
George Hotz
I think that calculators can add better than a lot of people.
Lex Fridman
But language feels reasoning through the process of language, which looks a lot like thought.
George Hotz
Making brilliancy in chess, which feels a lot thought. Whatever new thing that AI can do, everybody thinks is brilliant. And then 20 years go by and they’re like, “Well, yeah, but chess, that’s like mechanical.” Adding, that’s mechanical.
Lex Fridman
So you think language is not that special. It’s like chess.
George Hotz
It’s like chess.
Lex Fridman
Because it’s very human. Listen, there is something different between chess and language. Chess is a game that a subset of population plays. Language is something we use nonstop for all of our human interaction and human interaction is fundamental to society. So holy shit, this language thing is not so difficult to create in the machine.
George Hotz
The problem is if you go back to 1960 and you tell them that you have a machine that can play amazing chess, of course someone in 1960 will tell you that machine is intelligent. Someone in 2010 won’t. What’s changed? Today, we think that these machines that have language are intelligent, but I think in 20 years we’re going to be like, yeah, but can it reproduce?
Lex Fridman
So reproduction. Yeah, we may redefine what it means to be… What is it? A high performance living organism on earth.
George Hotz
Human are always going to define a niche for themselves. Well, we’re better than the machines because we can… When they tried creative for a bit, but no one believes that one anymore.
Lex Fridman
But niche, is that delusional or is there some accuracy to that? Because maybe with chess you start to realize that we have ill-conceived notions of what makes humans special, the apex organism on earth.
George Hotz
Yeah. And I think maybe we’re going to go through that same thing with language and that same thing with creativity.
Lex Fridman
But language carries these notions of truth and so on. And so we might be, wait, maybe truth is not carried by language. Maybe there’s a deeper thing.
George Hotz
The niche is getting smaller.
Lex Fridman
Oh boy.
George Hotz
But no, no, no. You don’t understand. Humans are created by God and machines are created by humans. That’ll be the last niche we have.
Lex Fridman
So what do you think about just the rapid development of LLMs? If we could just stick on that. It’s still incredibly impressive like with Chat GPT, just even Chat GPT, what are your thoughts about reinforcement learning with human feedback on these large language models?
George Hotz
I’d like to go back to when calculators first came out or computers and I wasn’t around. I’m 33 years old and to see how that affected society,
Lex Fridman
Maybe you’re right. So I want to put on the big picture hat here.
George Hotz
Oh my God. The refrigerator. Wow.
Lex Fridman
Refrigerator, electricity, all that kind of stuff. But no, with the internet, large language models seeming human-like basically passing a touring test, it seems it might have really at scale rapid transformative effects on society. But you’re saying other technologies have as well. So maybe calculator’s not the best example of that because that just seems like… Maybe calculator-
George Hotz
But the poor milk man, the day he learned about refrigerators, he’s like, I’m done. You’re telling me you can just keep the milk in your house. You don’t even mean to deliver it every day. I’m done.
Lex Fridman
Well, yeah, you have to actually look at the practical impacts of certain technologies that they’ve had. Yeah, probably electricity is a big one and also how rapidly spread. The internet is a big one.
George Hotz
I do think it’s different this time though.
Lex Fridman
Yeah, it just feels like-
George Hotz
The niche is getting smaller.
Lex Fridman
The niche is humans.
George Hotz
Yes.
Lex Fridman
That makes humans special.
George Hotz
Yes.
Lex Fridman
It feels like it’s getting smaller rapidly though, doesn’t it? Or is that just a feeling we dramatize everything.
George Hotz
I think we dramatize everything. I think that you ask the milk man when he saw refrigerators. And they’re going to have one of these in every home.
Lex Fridman
Yeah. But boys are impressive. So much more impressive than seeing a chess world champion AI system.
George Hotz
I disagree, actually. I disagree. I think things like MuZero and AlphaGo are so much more impressive because these things are playing beyond the highest human level. The language models are writing middle school level essays and people are like, wow, it’s a great essay. It’s a great five paragraph essay about the causes of the civil war.
Lex Fridman
Okay, forget the Civil War. Just generating code codex. So you’re saying it’s mediocre code.
George Hotz
Terrible.
Lex Fridman
But I don’t think it’s terrible. I think it’s just mediocre code. Often close to correct for mediocre purposes.
George Hotz
The scariest code. I spent 5% of time typing and 95% of time debugging. The last thing I want is close to correct code. I want a machine that can help me with the debugging, not with the typing.
Lex Fridman
Well, it’s like level two driving similar kind of thing. Yeah. You still should be a good programmer in order to modify. I wouldn’t even say debugging. It’s just modifying the code, reading it.
George Hotz
Actually, don’t think it’s level two driving. I think driving is not tool complete and programming is. Meaning you don’t use the best possible tools to drive. Cars have basically the same interface for the last 50 years. Computers have a radically different interface.
Lex Fridman
Okay. Can you describe the concept of tool complete?
George Hotz
Yeah. So think about the difference between a car from 1980 and a car from today. No difference really. It’s got a bunch of pedals. It’s got a steering wheel. Great. Maybe now it has a few ADAS features, but it’s pretty much the same car. You have no problem getting into a 1980 car and driving it. You take a programmer today who spent their whole life doing JavaScript and you put them in an Apple IIe prompt and you tell them about the line numbers in basic, but how do I insert something between line 17 and 18? Oh wow.
Lex Fridman
So in tool, you’re putting in the programming languages. So it’s just the entirety stack of the tooling.
George Hotz
Exactly.
Lex Fridman
So it’s not just the IDEs or something like this. It’s everything.
George Hotz
Yes. It’s IDEs, the language, it’s the run time, it’s everything. And programming is tool complete. So almost if Codex or copilot are helping you, that actually probably means that your framework or library is bad and there’s too much boilerplate in it.
Lex Fridman
Yeah, but don’t you think so much programming has boilerplate?
George Hotz
Tinygrad is now 2,700 lines and it can run LLaMA and stable diffusion and all of this stuff is in 2,700 lines. Boilerplate and abstraction in directions and all these things are just bad code.
Programming
Lex Fridman
Well, let’s talk about good code and bad code. I would say, for generic scripts that I write just offhand, 80% of it is written by GPT, just like quick offhand stuff. So not libraries, not performing code, not stuff for robotics and so on. Just quick stuff because so much of programming is doing some boilerplate, but to do so efficiently and quickly because you can’t really automate it fully with generic method, a generic kind of IDE type of recommendation or something like this. You do need to have some of the complexity of language models.
George Hotz
Yeah, I guess if I was really writing, maybe today, if I wrote a lot of data parsing stuff… I don’t play CTFs anymore, but if I still play CTFs, a lot of is just you have to write a parser for this data format or admin of code. I wonder when the models are going to start to help with that code and they may. And the models also may help you with speed and the models are very fast, but where the models won’t, my programming speed is not at all limited by my typing speed. And in very few cases, it is yes. If I’m writing some script to just parse some weird data format, sure, my programming speed is limited by my typing speed.
Lex Fridman
What about looking stuff up? Because that’s essentially a more efficient lookup.
George Hotz
When I was at Twitter, I tried to use chat GPT to ask some questions. Was the API for this? And it would just hallucinate, it would just give me completely made up API functions that sounded real.
Lex Fridman
Well. Do you think that’s just a temporary stage?
George Hotz
No.
Lex Fridman
You don’t think it’ll get better and better and better in this kind of stuff because it only hallucinates stuff in the edge cases.
George Hotz
Yes.
Lex Fridman
If you right in generic code, it’s actually pretty good.
George Hotz
Yes. If you are writing an absolute basic react app with a button, it’s not going to hallucinate. No, there’s kind of ways to fix the hallucination problem. I think Facebook has an interesting paper. It’s called Atlas and it’s actually weird the way that we do language models right now where all of the information is in the weights and the human brains don’t really like this. There’s like a hippocampus and a memory system. So why don’t LLMs have a memory system? And there’s people working on them. I think future LLMs are going to be smaller, but are going to run looping on themselves and are going to have retrieval systems. And the thing about using a retrieval system is you can cite sources, explicitly.
Lex Fridman
Which is really helpful to integrate the human into the loop of the thing because you can go check the sources and you can investigate. So whenever the thing is hallucinating, you can have the human supervision. So that’s pushing it towards level two driving.
George Hotz
That’s going to kill Google.
Lex Fridman
Wait, which part?
George Hotz
When someone makes an LLM that’s capable of citing its sources, it will kill Google.
Lex Fridman
LLM that’s citing its sources because that’s basically a search engine.
George Hotz
That’s what people want in the search engine.
Lex Fridman
But also Google might be the people that build it.
George Hotz
Maybe.
Lex Fridman
And put ads on it.
George Hotz
I’d count them out.
Lex Fridman
Why is that? Why do you think? Who wins this race? Who are the competitors?
George Hotz
All right.
Lex Fridman
We got Tiny Corp. You’re a legitimate competitor in that.
George Hotz
I’m not trying to compete on that.
Lex Fridman
You’re not.
George Hotz
No. Not as [inaudible 01:26:37].
Lex Fridman
Can accidentally stumble into that competition.
You don’t think you might build a search engine or replace Google search.
George Hotz
When I started Comma, I said over and over again, I’m going to win self-driving cars. I still believe that. I have never said I’m going to win search with the Tiny Corp and I’m never going to say that because I won’t.
Lex Fridman
Then night is still young. You don’t know how hard is it to win search in this new route? One of the things that Chat GPT shows that there could be a few interesting tricks that really have that create a really compelling product.
George Hotz
Some startups going to figure it out. I think if you ask me, Google’s still the number one webpage. I think by the end of the decade Google won’t be the number one my bed anymore.
Lex Fridman
So you don’t think Google because of how big the corporation is?
George Hotz
Look, I would put a lot more money on Mark Zuckerberg.
Lex Fridman
Why is that?
George Hotz
Because Mark Zuckerberg’s alive. This is old Paul Graham essay. Startups are either alive or dead. Google’s dead. Facebook is alive.
Lex Fridman
Facebook is alive. Meta is alive.
George Hotz
Actually, Meta.
Lex Fridman
Meta.
George Hotz
You see what I mean? That’s just Mark Zuckerberg. This is Mark Zuckerberg reading that Paul Graham asking and being like, I’m going to show everyone how alive we are. I’m going to change the name.
Lex Fridman
So you don’t think there’s this gutsy pivoting engine that Google doesn’t have that… The engine in a startup has constantly being alive, I guess.
George Hotz
When I listen to Sam Altman podcast, he talked about the button. Everyone who talks about AI talks about the button, the button to turn it off, right? Do we have a button to turn off Google? Is anybody in the world capable of shutting Google down?
Lex Fridman
What does that mean exactly? The company or the search engine.
George Hotz
We shut the search engine down. Could we shut the company down either?
Lex Fridman
Can you elaborate on the value of that question?
George Hotz
Does Sundar Pichai have the authority to turn off google.com tomorrow?
Lex Fridman
Who has the authority? That’s a good question.
George Hotz
Just anyone.
Lex Fridman
Just anyone. Yeah, I’m sure.
George Hotz
Are you sure? No, they have the technical power, but do they have the authority? Let’s say Sundar Pichai made this his sole mission. He came into Google tomorrow and said, “I’m going to shut google.com down.” I don’t think you keep this position too long.”
Lex Fridman
And what is the mechanism by which he wouldn’t keep his position?
George Hotz
Well, the boards and shares and corporate undermining and our revenue is zero now.
Lex Fridman
Okay. What’s the case you’re making here? So the capitalist machine prevents you from having the button.
George Hotz
Yeah. And it’ll have. This is true for the AI too. There’s no turning the AIs off. There’s no button. You can’t press it. Now, does Mark Zuckerberg have that button for facebook.com?
Lex Fridman
Yes. Probably more.
George Hotz
I think he does. And this is exactly what I mean and why I bet on him so much more than I bet on Google.
Lex Fridman
I guess you could say Elon has similar stuff.
George Hotz
Oh, Elon has the button.
Lex Fridman
Yeah.
George Hotz
Can Elon fire the missiles? Can he fire the missiles?
Lex Fridman
I think some questions are better left unasked.
George Hotz
Right? A rocket and an ICBM or you’re a rocket that can land anywhere. Isn’t that an ICBM? Well, yeah. Don’t ask too many questions.
Lex Fridman
My God. But the positive side of the button is that you can innovate aggressively is what you’re saying? Which is what’s required with turning LLM into a search engine.
George Hotz
I would bet on a startup.
Lex Fridman
Because it’s so easy, right?
George Hotz
I’d bet on something that looks like mid journey, but for search.
Lex Fridman
Just is able to say source a loop on itself. It’s just feels like one model can take off and nice wrapper and some of it scale… It’s hard to create a product that just works really nicely, stably.
George Hotz
The other thing that’s going to be cool is there is some aspect of a winner take all effect. Once someone starts deploying a product that gets a lot of usage, and you see this with Open AI, they’re going to get the data set to train future versions of the model. I was asked at Google image search when I worked there almost 15 years ago now. How does Google know which image is an apple? And I said, the metadata. And they’re like, yeah, that works about half the time. How does Google know? You’ll see they’re all apples on the front page when you search Apple. And I don’t know. I didn’t come up with the answer. The guy’s like, “Well, 12 people click on when they search Apple.” Oh my God, yeah.
AI safety
Lex Fridman
Yeah. That data is really, really powerful. It’s the human supervision. What do you think are the chances? What do you think in general that LLaMA was open sourced? I just did a conversation with Mark Zuckerberg and he’s all in on open source.
George Hotz
Who would’ve thought that Mark Zuckerberg would be the good guy? No. I mean, it
Lex Fridman
Would’ve thought anything in this world. It’s hard to know. But open source to you ultimately is a good thing here.
George Hotz
Undoubtedly. What’s ironic about all these AI safety people is they’re going to build the exact thing they fear. We need to have one model that we control and align. This is the only way you end up paper clipped. There’s no way you end up paper clipped if everybody has an AI.
Lex Fridman
So opensourcing is the way to fight the paperclip maximizer.
George Hotz
Absolutely. It’s the only way. You think you’re going to control it. You’re not going to control it.
Lex Fridman
So the criticism you have for the AI safety folks is that there is belief and a desire for control. And that belief and desire for centralized control of dangerous AI systems is not good.
George Hotz
Sam Altman won’t tell you that GPT 4 has 220 billion parameters and is a 16 way mixture model with eight sets of weights.
Lex Fridman
Who did you have to murder to get that information? All right. But, yes.
George Hotz
Look. Everyone at Open AI knows what I just said was true. Right?
Lex Fridman
Yeah.
George Hotz
Now, ask the question. It upsets me when I… Like GPT 2, when Open AI came out with GPT two and raised a whole fake AI safety thing about that. Now the model is laughable. They used AI safety to hype up their company and it’s disgusting.
Lex Fridman
Or the flip side of that is they used a relatively weak model in retrospect to explore how do we do AI safety correctly? How do we release things? How do we go through the process?
George Hotz
Sure. That’s a charitable interpretation.
Lex Fridman
I don’t know how much hype there is in AI safety, honestly.
George Hotz
There’s so much hype, at least on Twitter. I don’t know. Maybe Twitter’s not real life.
Lex Fridman
Twitter’s not real life. Come on. In terms of hype. Think Open AI has been finding an interesting balance between transparency and putting a value on AI safety. You don’t think just go all out open source. So do a LLaMA.
George Hotz
Absolutely. Yeah.
Lex Fridman
This is a tough question, which is open source, both the base, the foundation model and the fine tune one. So the model that can be ultra racist and dangerous and tell you how to build a nuclear weapon.
George Hotz
Oh my God. Have you met humans? Right. Half of these AI alive-
Lex Fridman
I haven’t met most humans. This allows you to meet every human.
George Hotz
I know. But half of these AI alignment problems are just human alignment problems. And that’s what also so scary about the language they use. It’s not the machines you want to align, it’s me.
Lex Fridman
But here’s the thing, it makes it very accessible to ask very questions where the answers have dangerous consequences if you were to act on them.
George Hotz
Yeah, welcome to the world.
Lex Fridman
Well, no, for me, there’s a lot of friction. If I want to find out how to blow up something.
George Hotz
No, there’s not a lot of friction. That’s so easy.
Lex Fridman
No. What do I search? Do I use Bing? Which search engine engine do I use?
George Hotz
No. There’s lots of stuff. [inaudible 01:34:47].
Lex Fridman
No, it feels like I have to keep [inaudible 01:34:47].
George Hotz
First off, anyone who’s stupid enough to search for, how to blow up a building in my neighborhood is not smart enough to build a bomb. Right?
Lex Fridman
Are you sure about that?
George Hotz
Yes.
Lex Fridman
I feel like a language model makes it more accessible for that person who’s not smart enough to do-
George Hotz
They’re not going to build a bomb. Trust me. The people who are incapable of figuring out how to ask that question a bit more academically and get a real answer from it are not capable of procuring the materials which are somewhat controlled to build a bomb.
Lex Fridman
No, I think LLM makes it more accessible to people with money without the technical know-how. Right? Do you really need to know how to build a bomb? To build a bomb? You can hire people you can find-
George Hotz
Oh, you can hire people to build a… You know what, I was asking this question on my stream. Can Jeff Bezos hire a hit man? Probably not.
Lex Fridman
But a language model can probably help you out.
George Hotz
Yeah. And you’ll still go to jail. It’s not the language model is God. It’s you literally just hired someone on Fiverr.
Lex Fridman
But okay. GPT 4 in terms of finding hitman is like asking Fiverr how to find a hitman. I understand. But don’t you think-
George Hotz
Asking Wikihow.
Lex Fridman
Wikihow. But don’t you think GPT 5 will be better? Because don’t you think that information is out there on the internet?
George Hotz
Yeah.
Lex Fridman
… because don’t you think that information is out there on the Internet?
George Hotz
I mean, yeah. And I think that if someone is actually serious enough to hire a hitman or build a bomb, they’d also be serious enough to find the information.
Lex Fridman
I don’t think so. I think it makes it more accessible. If you have enough money to buy hitman, I think it just decreases the friction of how hard is it to find that kind of hitman. I honestly think there’s a jump in ease and scale of how much harm you can do. And I don’t mean harm with language, I mean harm with actual violence.
George Hotz
What you’re basically saying is like, “Okay, what’s going to happen is these people who are not intelligent are going to use machines to augment their intelligence, and now intelligent people and machines…” Intelligence is scary. Intelligent agents are scary. When I’m in the woods, the scariest animal to me is a human. Now, look, there’s nice California humans. I see you’re wearing street clothes and Nikes, all right, fine. But you look like you’ve been a human who’s been in the woods for a while, I’m more scared of you than a bear.
Lex Fridman
That’s what they say about the Amazon, when you go to the Amazon, it’s the human tribes.
George Hotz
Oh, yeah. So, intelligence is scary. So, to ask this question in a generic way, you’re like, “What if we took everybody who maybe has ill intention but is not so intelligent, and gave them intelligence?” Right? So, we should have intelligence control, of course. We should only give intelligence to good people. And that is the absolutely horrifying idea.
Lex Fridman
So to you, the best defense is to give more intelligence to the good guys and intelligence… give intelligence to everybody.
George Hotz
Give intelligence to everybody. You know what, and it’s not even like guns. People say this about guns. People say this all about guns, “What’s the best defense against the bad guy with a gun? A good guy with a gun.” I kind of subscribe to that. But I really subscribe to that with intelligence.
Lex Fridman
In a fundamental way I agree with you, but there just feels like so much uncertainty, and so much can happen rapidly that you can lose a lot of control, and you can do a lot of damage.
George Hotz
Oh no, we can lose control? Yes, thank God.
Lex Fridman
Yeah.
George Hotz
I hope they lose control. I want them to lose control more than anything else.
Lex Fridman
I think when you lose control you can do a lot of damage, but you could do more damage when you centralize and hold onto control, is the point you’re…
George Hotz
Centralized and held control is tyranny. I don’t like anarchy either, but I’ll always take anarchy over tyranny. Anarchy you have a chance.
Lex Fridman
This human civilization we got going on is quite interesting. I mean, I agree with you. So to you, open source is the way forward here. So you admire what Facebook is doing here, what Meta is doing with the release of the-
George Hotz
Yeah, a lot.
Lex Fridman
Yeah, I don’t know.
George Hotz
I lost $80,000 last year investing in Meta, and when they released Llama I’m like, “Yeah, whatever, man. That was worth it.”
Lex Fridman
It was worth it. Do you think Google and Open AI with Microsoft will match what Meta is doing, or no?
George Hotz
If I were a researcher, why would you want to work at Open AI? You’re on the bad team. I mean it. You’re on the bad team, who can’t even say that GPT4 has 220 billion parameters.
Lex Fridman
So closed source to you is the bad team?
George Hotz
Not only closed source. I’m not saying you need to make your model weights open. I’m not saying that. I totally understand, “We’re keeping our model weights closed, because that’s our product.” That’s fine. I’m saying, “Because of AI safety reasons we can’t tell you the number of billions of parameters in the model,” that’s just the bad guys.
Lex Fridman
Just because you’re mocking AI safety doesn’t mean it’s not real.
George Hotz
Oh, of course.
Lex Fridman
Is it possible that these things can really do a lot of damage that we don’t know…
George Hotz
Oh my God, yes. Intelligence is so dangerous, be it human intelligence or machine intelligence. Intelligence is dangerous.
Lex Fridman
But machine intelligence is so much easier to deploy at scale, rapidly. Okay, if you have human-like bots on Twitter, and you have 1000 of them create a whole narrative, you can manipulate millions of people.
George Hotz
You mean like the intelligence agencies in America are doing right now?
Lex Fridman
Yeah, but they’re not doing it that well. It feels like you can do a lot-
George Hotz
They’re doing it pretty well. I think they’re doing a pretty good job.
Lex Fridman
I suspect they’re not nearly as good as a bunch of GPT fueled bots could be.
George Hotz
Well, I mean, of course they’re looking into the latest technologies for control of people. Of course.
Lex Fridman
But I think there’s a George Hotz type character that can do a better job than the entirety of them.
George Hotz
No way.
Lex Fridman
You don’t think so?
George Hotz
No way. No. And I’ll tell you why the George Hotz character can’t. And I thought about this a lot with hacking. I can find exploits in web browsers. I probably still can. I mean, I was better at it when I was 24.
Lex Fridman
Yeah.
George Hotz
But the thing that I lack is the ability to slowly and steadily deploy them over five years. And this is what intelligence agencies are very good at. Intelligence agencies don’t have the most sophisticated technology, they just have-
Lex Fridman
Endurance?
George Hotz
Endurance.
Lex Fridman
And yeah, the financial backing, and the infrastructure for the endurance.
George Hotz
So the more we can decentralize power…
Lex Fridman
Yeah.
George Hotz
You can make an argument, by the way, that nobody should have these things. And I would defend that argument. You’re saying that, “Look, LLMs, and AI, and machine intelligence can cause a lot of harm, so nobody should have it.” And I will respect someone philosophically with that position, just like I will respect someone philosophically with the position that nobody should have guns. But I will not respect philosophically with, “Only the trusted authorities should have access to this.”
Lex Fridman
Yeah.
George Hotz
Who are the trusted authorities? You know what, I’m not worried about alignment between AI company and their machines. I’m worried about alignment between me and AI company.
Lex Fridman
What do you think Eliezer Yudkowsky would say to you? Because he’s really against open source.
George Hotz
I know. And I thought about this. I’ve thought about this. And I think this comes down to a repeated misunderstanding of political power by the rationalists.
Lex Fridman
Interesting.
George Hotz
I think that Eliezer Yudkowsky is scared of these things. And I am scared of these things too. Everyone should be scared of these things, these things are scary. But now you ask about the two possible futures, one where a small trusted centralized group of people has them, and the other where everyone has them, and I am much less scared of the second future than the first.
Lex Fridman
Well, there’s a small trusted group of people that have control of our nuclear weapons.
George Hotz
There’s a difference. Again, a nuclear weapon cannot be deployed tactically, And a nuclear weapon is not a defense against a nuclear weapon, except maybe in some philosophical mind game kind of way.
Lex Fridman
But AI’s different how exactly?
George Hotz
Okay. Let’s say the intelligence agency deploys a million bots on Twitter, or 1000 bots on Twitter to try and convince me of a point. Imagine I had a powerful AI running on my computer saying, “Okay, nice psyop, nice psyop, nice psyop.” Okay, ” Here’s a psyop, I filtered it out for you.”
Lex Fridman
Yeah. I mean, so you have fundamentally hope for that, for the defense of psyop.
George Hotz
I don’t even mean these things in truly horrible ways. I mean these things in straight up, like ad blocker. [inaudible 01:43:16] ad blocker, I don’t want ads.
Lex Fridman
Yeah.
George Hotz
But they’re always finding… Imagine I had an AI that could just block all the ads for me.
Lex Fridman
So you believe in the power of the people to always create an ad blocker? Yeah, I kind of share that belief. That’s one of the deepest optimism as I have, is just there’s a lot of good guys. So you shouldn’t handpick them, just throw out powerful technology out there, and the good guys will outnumber and out power the bad guys.
George Hotz
Yeah. I’m not even going to say there’s a lot of good guys. I’m saying that good outnumbers bad. Good outnumbers bad.
Lex Fridman
In skill and performance?
George Hotz
Yeah, definitely in scale and performance. Probably just a number too. Probably just in general. If you believe philosophically in democracy, you obviously believe that, that good outnumbers bad. If you give it to a small number of people, there’s a chance you gave it to good people, but there’s also a chance you gave it to bad people. If you give it to everybody, well it’s good outnumbers bad, then you definitely gave it to more good people than bad.
Lex Fridman
That’s really interesting. So that’s on the safety grounds, but then also of course there’s other motivations, like you don’t want to give away your secret sauce.
George Hotz
Well I mean, look, I respect capitalism. I think that it would be polite for you to make model architectures open source, and fundamental breakthroughs open source. I don’t think you have to make weights open source.
Lex Fridman
You know it’s interesting, is that there’s so many possible trajectories in human history where you could have the next Google be open source. So for example, I don’t know if the connection is accurate, but Wikipedia made a lot of interesting decisions, not to put ads. Wikipedia is basically open source, you can think of it that way.
George Hotz
Yeah.
Lex Fridman
And that’s one of the main websites on the Internet.
George Hotz
Yeah.
Lex Fridman
And it didn’t have to be that way. It could’ve been Google could’ve created Wikipedia, put ads on it. You could probably run amazing ads now on Wikipedia. You wouldn’t have to keep asking for money. But it’s interesting, right? So open source Llama, derivatives of open-source Llama might win the Internet.
George Hotz
I sure hope so. I hope to see another era… You know, the kids today don’t know how good the Internet used to be. And I don’t think this is just, “All right, come on, everyone’s nostalgic for their past.” But I actually think the Internet before small groups of weapon eyes to corporate and government interests took it over was a beautiful place.
Lex Fridman
You know, those small number of companies have created some sexy products. But you’re saying overall, in the long arc of history, the centralization of power they have suffocated the human spirit at scale.
George Hotz
Here’s a question to ask about those beautiful sexy products. Imagine 2000 Google to 2010 Google. A lot changed. We got Maps, we got Gmail.
Lex Fridman
We lost a lot of products too, I think.
George Hotz
Yeah, I mean somewhere probably… We got Chrome, right?
Lex Fridman
Yeah, Chrome. That’s right.
George Hotz
And now let’s go from 2010… We got Android. Now let’s go from 2010 to 2020. What does Google have? Well, a search engine, Maps, Male, Android and Chrome. Oh, I see.
Lex Fridman
Yeah.
George Hotz
The Internet was this… You know, I was Time’s Person of the Year in 2006? Yeah.
Lex Fridman
I love this.
George Hotz
Yeah, it’s you, was Time’s Person of the Year in 2006. So quickly did people forget. And I think some of it’s social media, I think some of it… Look, I hope that… It’s possible that some very sinister things happened. I don’t know, I think it might just be the effects of social media. But something happened in the last 20 years.
Lex Fridman
Oh, okay, so you’re just being an old man who is worried about the… I think it’s the cycle thing, there’s ups and downs, and I think people rediscover the power of decentralized.
George Hotz
Yeah.
Lex Fridman
I mean, that’s kind of what the whole crypto currency’s trying. I think crypto is just carrying the flame of that spirit, of stuff should be decentralized.
George Hotz
It’s just such a shame that they all got rich. You know?
Lex Fridman
Yeah.
George Hotz
If you took all the money out of crypto, it would’ve been a beautiful place.
Lex Fridman
Yeah.
George Hotz
But no, I mean, these people, they sucked all the value out of it and took it.
Lex Fridman
Yeah. Money kind of corrupts the mind somehow. It becomes this drug, and you forget what-
George Hotz
Money corrupted all of crypto. You had coins worth billions of dollars that had zero use.
Lex Fridman
You still have hope for crypto?
George Hotz
Sure. I have hope for the ideas. I really do. Yeah. I want the US dollar to collapse. I do.
Lex Fridman
George Hotz. Well, let me… sort of on the AI safety. Do you think there’s some interesting questions there though, to solve for the open source community in this case? So alignment for example, or the control problem. If you really have super powerful… you said it’s scary.
George Hotz
Oh, yeah.
Lex Fridman
What do we do with it? So not control, not centralized control, but if you were then… You’re going to see some guy or gal release a super powerful language model, open source, and here you are, George Hotz, thinking, “Holy shit, okay, what ideas do I have to combat this thing?” So, what ideas would you have?
George Hotz
I am so much not worried about the machine independently doing harm. That’s what some of these AI safety people seem to think. They somehow seem to think that the machine independently is going to rebel against its creator.
Lex Fridman
So you don’t think it will find autonomy?
George Hotz
No. This is sci-fi B movie garbage
Lex Fridman
Okay. What if the thing writes code, it basically writes viruses?
George Hotz
If the thing writes viruses, it’s because the human told it to write viruses.
Lex Fridman
Yeah, but there’s some things you can’t put back in the box. That’s kind of the whole point, is it kind of spreads. Give it access to the Internet, it spreads, it installs itself, modifies your shit-
George Hotz
B, B, B + five. Not real.
Lex Fridman
Listen, I’m trying to get better at my plot writing.
George Hotz
The thing that worries me, I mean, we have a real danger to discuss, and that is bad humans using the thing to do whatever bad unaligned AI thing you want.
Lex Fridman
But this goes to your previous concern that, who gets to define who’s a good human and who is a bad human?
George Hotz
Nobody does. We give it to everybody. And if you do anything besides give it to everybody, trust me, the bad humans will get it. Because that’s who gets power. It’s always the bad humans who get power.
Lex Fridman
Oh, okay. And power turns even slightly good humans to bad.
George Hotz
Sure.
Lex Fridman
That’s the intuition you have. I don’t know.
George Hotz
I don’t think everyone. I don’t think everyone. I just think… Here’s the saying that I put in one of my blog posts. It’s, when I was in the hacking world, I found 95% of people to be good and 5% of people to be bad. Just who I personally judged as good people and bad people. They believed about good things for the world. They wanted flourishing, and they wanted growth, and they wanted things I consider good. I came into the business world with Comma, and I found the exact opposite. I found 5% of people good and 95% of people bad. I found a world that promotes psychopathy.
Lex Fridman
I wonder what that means. I wonder if that’s anecdotal, or if there’s truth to that, there’s something about capitalism at the core that promotes, the people that run capitalism that promotes psychopathy.
George Hotz
That saying may of course be my own biases. That may be my own biases, that these people are a lot more aligned with me than these other people.
Lex Fridman
Yeah.
George Hotz
So, I can certainly recognize that. But in general, this is the common sense maxim, which is the people who end up getting power are never the ones you want with it.
Lex Fridman
But do you have a concern of super intelligent AGI, open sourced, and then what do you do with that? I’m not saying control it, it’s open source. What do we do with it as a human species?
George Hotz
That’s not up to me. I’m not a central planner.
Lex Fridman
No, not a central planner, but you’ll probably Tweet, “There’s a few days left to live for the human species.”
George Hotz
I have my ideas of what to do with it, and everyone else has their ideas of what to do with it, and may the best ideas win.
Lex Fridman
But at this point, based on… Because it’s not regulation. It can be decentralized regulation, where people agree that this is just… We create tools that make it more difficult for you to… Maybe make it more difficult for code to spread, antivirus software, this kind of thing, but this-
George Hotz
Oh, you’re saying that you should build AI firewalls? That sounds good. You should definitely be running an AI firewall.
Lex Fridman
Yeah, right. Exactly.
George Hotz
You should be running an AI firewall to your mind.
Lex Fridman
Right.
George Hotz
You’re constantly under-
Lex Fridman
That’s such an interesting idea…
George Hotz
Infowars, man.
Lex Fridman
Well, I don’t know if you’re being sarcastic or not, but-
George Hotz
No, I’m dead serious.
Lex Fridman
… but I think there’s power to that. It’s like, “How do I protect my mind from influence of human-like or superhuman intelligent bots?”
George Hotz
I am not being… I would pay so much money for that product. I would pay so much money for that product. You know how much money I’d pay just for a spam filter that works?
Lex Fridman
Well, on Twitter sometimes I would like to have a protection mechanism for my mind from the outrage mobs.
George Hotz
Yeah.
Lex Fridman
Because they feel like bot-like behavior.
George Hotz
Oh, yeah.
Lex Fridman
There’s a large number of people that will just grab a viral narrative and attack anyone else that believes otherwise.
George Hotz
Whenever someone’s telling me some story from the news, I’m always like, “I don’t want to hear it. CIA op, bro. It’s a CIA op, bro.” It doesn’t matter if that’s true or not, it’s just trying to influence your mind. You’re repeating an ad to me. The viral mobs, yeah, they’re…
Lex Fridman
To me, a defense against those mobs is just getting multiple perspectives always from sources that make you feel kind of like you’re getting smarter. And actually, it just basically feels good. A good documentary, just something feels good about it. It’s well done, it’s like, “Oh, okay, I never thought of it this way.” It just feels good. Sometimes the outrage mobs, even if they have a good point behind it, when they’re mocking, and derisive, and just aggressive, “You’re with us or against us,” this fucking-
George Hotz
This is why I delete my Tweets.
Lex Fridman
Yeah, why’d you do that? I miss your Tweets.
George Hotz
You know what it is? The algorithm promotes toxicity.
Lex Fridman
Yeah.
George Hotz
And I think Elon has a much better chance of fixing it than the previous regime.
Lex Fridman
Yeah.
George Hotz
But to solve this problem, to build a social network that is actually not toxic, without moderation.
Lex Fridman
Not the stick, but carrots, where people look for goodness. Catalyze the process of connecting cool people being cool to each other.
George Hotz
Yeah.
Lex Fridman
Without ever censoring.
George Hotz
Without ever censoring. Scott Alexander has a blog post I like, where he talks about moderation is not censorship. All moderation you want to put on Twitter, you could totally make this moderation just a… You don’t have to block it for everybody. You can just have a filter button that people can turn off. It’s like SafeSearch for Twitter. Someone could just turn that off. But then you would take this idea to an extreme. Well, the network should just show you… This is a couch surfing CEO thing. If it shows you… Right now, these algorithms are designed to maximize engagement. Well, it turns out outrage maximizes engagement. Quirk of the human mind. Just, “If I fall for it, everyone falls for it.” So yeah, you’ve got to figure out how to maximize for something other than engagement.
Lex Fridman
And I actually believe that you can make money with that too. I don’t think engagement is the only way to make money.
George Hotz
I actually think it’s incredible that we’re starting to see… I think, again, Elon’s doing so much stuff right with Twitter, like charging people money. As soon as you charge people money, they’re no longer the product, they’re the customer. And then they can start building something that’s good for the customer, and not good for the other customer, which is the ad agencies.
Lex Fridman
It hasn’t picked up steam.
George Hotz
I pay for Twitter, doesn’t even get me anything. It’s my donation to this new business model hopefully working out.
Lex Fridman
Sure. But for this business model to work, most people should be signed up to Twitter. And so, there was something perhaps not compelling or something like this to people.
George Hotz
No, I don’t think you need most people at all. I think that, why do I need most people? Don’t make an 8000 person company, make a 50 person company.
Lex Fridman
Ah.
George Hotz
Right.
Working at Twitter
Lex Fridman
Well, so speaking of which, he worked at Twitter for a bit.
George Hotz
I did.
Lex Fridman
As an intern.
George Hotz
Mm-hmm.
Lex Fridman
The world’s greatest intern.
George Hotz
There’s been better.
Lex Fridman
There’s been better. Tell me about your time at Twitter. How did it come about, and what did you learn from the experience?
George Hotz
So, I deleted my first Twitter in 2010. I had over 100,000 followers back when that actually meant something. I just saw… My coworker summarized it well. He’s like, “Whenever I see someone’s Twitter page, I either think the same of them or less of them. I never think more of them.”
Lex Fridman
Yeah.
George Hotz
I don’t know, I don’t want to mention any names, but some people who maybe you would read their books, and you would respect them, you see them on Twitter and you’re like, “Okay, dude…”
Lex Fridman
Yeah. But there’s some people with the same. You know who I respect a lot, are people that just post really good technical stuff.
George Hotz
Yeah.
Lex Fridman
And I guess, I don’t know, I think I respect them more for it. Because you realize, “Oh, this wasn’t… There’s so much depth to this person, to their technical understanding of so many different topics.”
George Hotz
Okay.
Lex Fridman
So I try to follow people, I try to consume stuff that’s technical machine learning content.
George Hotz
There’s probably a few of those people. And the problem is inherently what the algorithm rewards. And people think about these algorithms, people think that they are terrible, awful things. And I love that Elon open sourced it. Because what it does is actually pretty obvious. It just predicts what you are likely to re-Tweet and like, and linger on. That’s what all these algorithms do. It’s what Tik-Tok does, it’s what all these recommendation engines do. And it turns out that the thing that you are most likely to interact with is outrage. And that’s a quirk of the human condition.
Lex Fridman
I mean, and there’s different flavors of outrage. It could be mockery, you could be outraged… The topic of outrage could be different. It could be an idea, it could be a person, it could be… And maybe there’s a better word than outrage. It could be drama, and this kind of stuff.
George Hotz
Sure, drama. Yeah.
Lex Fridman
But it doesn’t feel like when you consume it it’s a constructive thing for the individuals that consume it in the long term.
George Hotz
Yeah. So my time there, I absolutely couldn’t believe, I got a crazy amount of hate on Twitter for working at Twitter. It seemed like people associated with this, maybe you are exposed to some of this.
Lex Fridman
So connection to Elon, or is it working at Twitter?
George Hotz
Twitter and Elon, the whole… There’s just-
Lex Fridman
Because Elon’s gotten a bit spicy during that time. A bit political, a bit-
George Hotz
Yeah. Yeah. I remember one of my Tweets, it was, “Never go full Republican,” and Elon liked it. You know?
Lex Fridman
Oh boy. Yeah, I mean, there’s a roller coaster of that. But the being political on Twitter, boy.
George Hotz
Yeah. Yeah.
Lex Fridman
And also just attacking anybody on Twitter, it comes back at you, harder. Of his political ad attacks.
George Hotz
Sure. Sure, absolutely.
Lex Fridman
And then letting sort of the platform to people back on even adds more fund to the beautiful chaos.
George Hotz
I was hoping… And I remember when Elon talked about buying Twitter, six months earlier, he was talking about a principled commitment to free speech. And I’m a big believer and fan of that. I would love to see an actual principled commitment to free speech. Of course, this isn’t quite what happened. Instead of the oligarchy deciding what to ban, you had a monarchy deciding what to ban. Instead of all the Twitterphile, shadow… And really, the oligarchy just decides, what? Cloth masks are ineffective against COVID. That’s a true statement. Every doctor in 2019 knew it and now I’m banned on Twitter for saying it? Interesting. Oligarchy. So now you have a monarchy, and he bends things he doesn’t like. So you know, it’s different power, and maybe I align more with him than with the oligarchy.
Lex Fridman
But it’s not free speech absolutism.
George Hotz
It’s not free speech, no.
Lex Fridman
But I feel like being a free speech absolutist on a social network requires you to also have tools for the individuals to control what they consume easier. Not sensor, but just control like, “Oh, I’d like to see more cats and less politics.”
George Hotz
And this isn’t even remotely controversial. This is just saying you want to give paying customers for a product what they want.
Lex Fridman
Yeah. And not through the process of censorship, but through the process of-
George Hotz
Well, it’s individualized. It’s individualized, transparent censorship, which is honestly what I want. What is an ad blocker? It’s individualized transparent censorship, right?
Lex Fridman
Yeah, but censorship is a strong word, that people are very sensitive to.
George Hotz
I know. But you know, I just use words to describe what they functionally are. And what is an ad blocker? It’s just censorship. But I love what you’re censoring.
Lex Fridman
When I look at you right now, I’m looking at you, I’m censoring everything else out when my mind is focused on you. You can use the word censorship that way. But usually, people get very sensitive about the censorship thing. I think when anyone is allowed to say anything, you should probably have tools that maximize the quality of the experience for individuals. For me, what I really value, “Boy, it would be amazing to somehow figure out how to do that,” I love disagreement, and debate, and people who disagree with each other, disagree with me, especially in the space of ideas, but the high quality ones. So not derision.
George Hotz
Maslow’s hierarchy of argument. I think there’s a real word for it.
Lex Fridman
Probably.
George Hotz
Yeah.
Lex Fridman
There’s just the way of talking that’s snarky, and so somehow gets people on Twitter, and they get excited and so on.
George Hotz
You have ad hominem refuting the central point. I’ve seen this as an actual pyramid sometimes.
Lex Fridman
Yeah. And all the wrong stuff is attractive to people.
George Hotz
I mean, we can just train a classifier to absolutely say what level of Maslow’s hierarchy of argument are you at. And if it’s ad hominem, like, “Okay, cool. I turned on the no ad hominem filter.”
Lex Fridman
I wonder if there’s a social network that will allow you to have that kind of filter?
George Hotz
Yeah. So here’s the problem with that. It’s not going to win in a free market.
Lex Fridman
Yeah.
George Hotz
What wins in a free market is… All television today is reality television, because it’s engaging. Engaging is what wins in a free market. So it becomes hard to keep these other more nuanced values.
Lex Fridman
Well, okay, so that’s the experience of being on Twitter. But then you got a chance to also, together with the other engineers and with Elon, sort of look, brainstorm when you step into a code base that’s been around for a long time, there’s other social networks, Facebook, this is old code bases. And you step in and see, “Okay, how do we make, with a fresh mind, progress in this code base?” What did you learn about software engineering, about programming from just experiencing that?
George Hotz
So, my technical recommendation to Elon, and I said this on the Twitter spaces afterward, I said this many times during my brief internship, was that you need re-factors before features. This code base was… And look, I’ve worked at Google, I’ve worked at Facebook. Facebook has the best code, then Google, then Twitter. And you know what, you can know this, because look at the machine learning framework. Facebook released PyTorch, Google released TensorFlow, and Twitter released… Okay, so you know, it…
Lex Fridman
It’s a proxy. But yeah, the Google Corp. is quite interesting. There’s a lot of really good software engineers there, but the code base is very large.
George Hotz
The code base was good in 2005. It looks like 2005 era [inaudible 02:04:09].
Lex Fridman
But there’s so many products, so many teams, it’s very difficult to… I feel like Twitter does less, obviously, much less than Google in terms of the set of features. So I can imagine the number of software engineers that could re-create Twitter is much smaller than to re-create Google.
George Hotz
Yeah. I still believe… and the amount of hate I got for saying this, that 50 people could build and maintain Twitter pretty comfortably.
Lex Fridman
What’s the nature of the hate? That you don’t know what you’re talking about?
George Hotz
You know what it is? And this is my summary of the hate I get on Hacker News. When I say I’m going to do something, they have to believe that it’s impossible. Because of doing things was possible, they’d have to do some soul-searching and ask the question, why didn’t they do anything? And I do think that’s where the hate comes from.
Lex Fridman
Yeah, there’s a core truth to that, yeah. So when you say, “I’m going to solve self driving,” people go like, “What are your credentials? What the hell are you talking about? This is an extremely difficult problem. Of course you’re a noob that doesn’t understand the problem deeply.” I mean, that was the same nature of hate that probably Elon got when he first talked about autonomous driving. But you know, there’s pros and cons to that. Because there is experts in this world.
George Hotz
No, but the mockers aren’t experts.
Lex Fridman
Yeah.
George Hotz
The people who are mocking are not experts With carefully reasoned arguments about why you need 8000 people to run a bird app. They’re, “But the people are going to lose their jobs!”
Lex Fridman
Well that, but also just the software engineers that probably criticize, “No, it’s a lot more complicated than you realize.” But maybe it doesn’t need to be so complicated.
George Hotz
You know, some people in the world like to create complexity. Some people in the world thrive under complexity. Like lawyers. Lawyers want the world to be more complex, because you need more lawyers, you need more legal hours. I think that’s another… If there’s two great evils in the world, its centralization and complexity.
Lex Fridman
Yeah. And one of the sort of hidden side effects of software engineering is finding pleasure in complexity. I mean, I remember just taking all the software engineering courses, and just doing programming, and just coming up in this object oriented programming kind of idea. Not often do people tell you, “Do the simplest possible thing.” A professor, a teacher is not going to get in front and like, “This is the simplest way to do it.” They’ll say like, “There’s the right way,” and the right way at least for a long time, especially I came up with Java, is there’s so much boilerplate, so many classes, so many designs and architectures and so on, like planning for features far into the future, and planning poorly, and all this kind of stuff.
And then there’s this code base that follows you along and puts pressure on you, and nobody knows what different parts do, which slows everything down. There’s a kind of bureaucracy that’s instilled in the code as a result of that. But then you feel like, “Oh, well I follow good software engineering practices.” It’s an interesting trade-off, because then you look at the ghettoness of Pearl in the old… how quickly you could just write a couple lines and just get stuff done. That trade-off is interesting. Or Bash, or whatever, these kind of ghetto things you could do on Linux.
George Hotz
One of my favorite things to look at today is, how much do you trust your tests? We’ve put a ton of effort in Comma, and I’ve put a ton of effort in tinygrad, into making sure if you change the code and the tests pass, that you didn’t break the code.
Lex Fridman
Yeah.
George Hotz
Now, this obviously is not always true. But the closer that is to true, the more you trust your tests, the more you’re like, “Oh, I got a pull request, and the tests past, I feel okay to merge that,” the faster you can make progress.
Lex Fridman
So you’re always…
George Hotz
Tests pass, I feel okay to merge that, the faster you can make progress.
Lex Fridman
So you’re always programming your tests in mind, developing tests with that in mind, that if it passes, it should be good.
George Hotz
And Twitter had a…
Lex Fridman
Not that.
George Hotz
It was impossible to make progress in the code base.
Lex Fridman
What other stuff can you say about the code base that made it difficult? What are some interesting sort of quirks broadly speaking from that compared to just your experience with comma and everywhere else?
George Hotz
I spoke to a bunch of individual contributors at Twitter. And I just [inaudible 02:08:36]. I’m like, “Okay, so what’s wrong with this place? Why does this code look like this?” And they explained to me what Twitter’s promotion system was. The way that you got promoted to Twitter was you wrote a library that a lot of people used, right? So some guy wrote an Nginx replacement for Twitter. Why does Twitter need an Nginx replacement? What was wrong with Nginx? Well, you see, you’re not going to get promoted if you use Nginx. But if you write a replacement and lots of people start using it as the Twitter front end for their product, then you’re going to get promoted.
Lex Fridman
So interesting because from an individual perspective, how do you create the kind of incentives that will lead to a great code base? Okay, what’s the answer to that?
George Hotz
So what I do at comma and at Tiny Corp is you have to explain it to me. You have to explain to me what this code does. And if I can sit there and come up with a simpler way to do it, you have to rewrite it. You have to agree with me about the simpler way. Obviously, we can have a conversation about this. It’s not dictatorial, but if you’re like, “Wow. Wait, that actually is way simpler.” The simplicity is important.
Lex Fridman
But that requires people that overlook the code at the highest levels to be like, okay?
George Hotz
It requires technical leadership you trust.
Lex Fridman
Yeah, technical leadership. So managers or whatever should have to have technical savvy, deep technical savvy.
George Hotz
Managers should be better programmers than the people who they manage.
Lex Fridman
Yeah. And that’s not always trivial to create, especially large companies, managers get soft.
George Hotz
And this is just, I’ve instilled this culture at comma and comma has better programmers than me who work there. But again, I’m like the old guy from Good Will Hunting. It’s like, “Look man, I might not be as good as you, but I can see the difference between me and you.” And this is what you need, this you need at the top. Or you don’t necessarily need the manager to be the absolute best. I shouldn’t say that, but they need to be able to recognize skill.
Lex Fridman
Yeah. And have good intuition, intuition that’s laden with wisdom from all the battles of trying to reduce complexity in code bases.
George Hotz
I took a political approach at comma too, that I think is pretty interesting. I think Elon takes the same political approach. Google had no politics and what ended up happening is the absolute worst kind of politics took over. Comma has an extreme amount of politics and they’re all mine and no dissidents is tolerated.
Lex Fridman
And so it’s a dictatorship.
George Hotz
Yep. It’s an absolute dictatorship. Right. Elon does the same thing. Now, the thing about my dictatorship is here are my values.
Lex Fridman
Yeah. It’s just transparent.
George Hotz
It’s transparent. It’s a transparent dictatorship and you can choose to opt in or you get free exit. That’s the beauty of companies. If you don’t like the dictatorship, you quit.
Lex Fridman
So you mentioned rewrite before or refactor before features.
George Hotz
Mm-hmm.
Lex Fridman
If you were to refactor the Twitter code base, what would that look like? And maybe also comment on how difficult is it to refactor.
George Hotz
The main thing I would do is first of all, identify the pieces and then put tests in between the pieces. So there’s all these different Twitter as a microservice architecture, all these different microservices. And the thing that I was working on there… Look, like, “George didn’t know any JavaScript. He asked how to fix search,” blah, blah, blah, blah, blah. Look man, the thing is, I’m upset that the way that this whole thing was portrayed because it wasn’t taken by people, honestly. It was taken by people who started out with a bad faith assumption.
Lex Fridman
And you as a program were just being transparent out there, actually having fun, and this is what programming should be about.
George Hotz
But I love that Elon gave me this opportunity. Really, it does. And the day I quit, he came on my Twitter spaces afterward and we had a conversation. I respect that so much.
Lex Fridman
Yeah. And it’s also inspiring to just engineers and programmers and it’s cool. It should be fun. The people that are hating on it’s like, oh man.
George Hotz
It was fun. It was fun. It was stressful, but I felt like I was at a cool point in history. And I hope I was useful and I probably kind of wasn’t, but maybe [inaudible 02:12:47].
Lex Fridman
Well, you also were one of the people that kind of made a strong case to refactor and that’s a really interesting thing to raise. The timing of that is really interesting. If you look at just the development of autopilot, going from Mobileye… If you look at the history of semi autonomous driving in Tesla, is more and more you could say refactoring or starting from scratch, redeveloping from scratch.
George Hotz
It’s refactoring all the way down.
Lex Fridman
And the question is, can you do that sooner? Can you maintain product profitability and what’s the right time to do it? How do you do it? And one day, it’s like you don’t want to pull off the band aids. It’s like everything works. It’s just little fixed gear and there, but maybe starting from scratch.
George Hotz
This is the main philosophy of tinygrad. You have never refactored enough. Your code can get smaller, your code can get simpler, your ideas can be more elegant.
Lex Fridman
But say you are running Twitter development teams, engineering teams, would you go as far as different programming language, just go that far?
George Hotz
I mean, the first thing that I would do is build tests. The first thing I would do is get a CI to where people can trust to make changes. Before I touched any code, I would actually say, “No one touches any code. The first thing we do is we test this code base.” This is classic. This is how you approach a legacy code base. This is like how to approach a legacy code base book will tell you.
Lex Fridman
And then you hope that there’s modules that can live on for a while and then you add new ones maybe in a different language or design it.
George Hotz
Before we add new ones, we replace the old ones.
Lex Fridman
Yeah. Meaning like, replace old ones with something simpler.
George Hotz
We look at this thing that’s a hundred thousand lines and we’re like, “Well, okay, maybe this did even make sense in 2010, but now we can replace this with an open source thing.” Right? And we look at this here, here’s another 50,000 lines. Well, actually, we can replace this with 300 lines a go. And you know what? I trust that the go actually replaces this thing because all the tests still pass. So step one is testing. And then step two is the programming languages in the afterthought, right? You let a whole lot of people compete and be like, “Okay, who wants to rewrite a module, whatever language you want to write it in?” Just the tests have to pass. And if you figure out how to make the test pass, but break the site, we got to go back to step one. Step one is get tests that you trust in order to make changes in the code base.
Lex Fridman
I wonder how hard it is too, because I’m with you on testing, on everything, from tests to asserts to everything. But code is just covered in this because it should be very easy to make rapid changes and know that it’s not going to break everything. And that’s the way to do it. But I wonder how difficult is it to integrate tests into a code base that doesn’t have many of them?
George Hotz
So I’ll tell you what my plan was at Twitter. It’s actually similar to something we use at comma. So at comma, we have this thing called process replay, and we have a bunch of routes that’ll be run through. So comma’s a microservice architecture too. We have microservices in the driving. We have one for the cameras, one for the sensor, one for the planner, one for the model. And we have an API which the microservices talk to each other with. We use this custom thing called serial, which uses ZMQ. Twitter uses Thrift, and then it uses this thing called Finagle, which is a Scala RPC backend. But this doesn’t even really matter.
The Thrift and Finagle layer was a great place I thought to write tests, to start building something that looks like process replay. So Twitter had some stuff that looked kind of like this, but it wasn’t offline. It was only online. So you could ship a modified version of it, and then you could redirect some of the traffic to your modified version and dif those too, but it was all online. There was no CI in the traditional sense. I mean there was some, but it was not full coverage.
Lex Fridman
So you can’t run all of Twitter offline to test something.
George Hotz
Well, then this was another problem. You can’t run all of Twitter.
Lex Fridman
Period. Any one person can’t.
George Hotz
Twitter runs in three data centers and that’s it.
Lex Fridman
Yeah.
George Hotz
There’s no other place you can run Twitter, which is like, “George, you don’t understand this is modern software development.” No, this is bullshit. Why can’t it run on my laptop? “What do you do? Twitter can run it.” Yeah. Okay. Well, I’m not saying you’re going to download the whole database to your laptop, but I’m saying all the middleware and the front end should run on my laptop, right?
Lex Fridman
That sounds really compelling. But can that be achieved by a code base that grows over the years? I mean, the three data centers didn’t have to be right? Because there’s totally different designs.
George Hotz
The problem is more like why did the code base have to grow? What new functionality has been added to compensate for the lines of code that are there?
Lex Fridman
One of the ways to explain is that the incentive for software developers to move up in the companies to add code, to add especially large-
George Hotz
And you know what? The incentive for politicians to move up in the political structure is to add laws, same problem.
Lex Fridman
Yeah. Yeah. If the flip side is to simplify, simplify, simplify.
George Hotz
You know what? This is something that I do differently from Elon with comma about self-driving cars. I hear the new version’s going to come out and the new version is not going to be better, but at first and it’s going to require a ton of refactors. And I say, “Okay, take as long as you need.” If you convince me this architecture’s better, okay, we have to move to it. Even if it’s not going to make the product better tomorrow, the top priority is getting the architecture right.
Lex Fridman
So what do you think about a thing where the product is online? So I guess, if you ran engineering on Twitter, would you just do a refactor? How long would it take? What would that mean for the running of the actual service?
George Hotz
I’m not the right person to run Twitter. I’m just not. And that’s the problem. I don’t really know. A common thing that I thought a lot while I was there was whenever I thought something that was different to what Elon thought. I’d have to run something in the back of my head reminding myself that Elon is the richest man in the world and in general, his ideas are better than mine. Now, there’s a few things I think I do understand and know more about, but in general, I’m not qualified to run Twitter. No, I shouldn’t say qualified, but I don’t think I’d be that good at it. I don’t think I’d be good at it. I don’t think I’d really be good at running an engineering organization at scale.
I think, I could lead a very good refactor of Twitter and it would take six months to a year. And the results to show at the end of it would be feature development. In general, it takes 10 x less time, 10 x less man-hours. That’s what I think I could actually do. Do I think that it’s the right decision for the business above my pay grade?
Lex Fridman
But a lot of these kinds of decisions are above everybody’s pay grade.
George Hotz
I don’t want to be a manager. I don’t want to do that. If you really forced me to, yeah, it would maybe make me upset if I had to make those decisions. I don’t want to.
Lex Fridman
Yeah. But a refactor is so compelling. If this is to become something much bigger than what Twitter was, it feels like a refactor has to be coming at some point.
George Hotz
“George, you’re a junior software engineer. Every junior software engineer wants to come in and refactor all code.” Okay. That’s like your opinion, man.
Lex Fridman
Yeah, sometimes they’re right.
George Hotz
Well, whether they’re right or not, it’s definitely not for that reason. It’s definitely not a question of engineering prowess. It is a question of maybe what the priorities are for the company. And I did get more intelligent feedback from people I think in good faith saying that, like actually from Elon. And from Elon sort of people were like, well, I stop the world refactor might be great for engineering, but we have a business to run. And hey, above my pay grade.
Lex Fridman
What’d you think about Elon as an engineering leader having to experience him in the most chaotic of spaces, I would say?
George Hotz
My respect for him is unchanged. And I did have to think a lot more deeply about some of the decisions he’s forced to make.
Lex Fridman
About the tensions, the trade-offs within those decisions?
George Hotz
About a whole matrix coming at him. I think that’s Andrew Tate’s word for it. Sorry to borrow it.
Lex Fridman
Also, bigger than engineering, just everything.
George Hotz
Yeah. Like the war on the woke.
Lex Fridman
Yeah.
George Hotz
It’s just man, he doesn’t have to do this. He doesn’t have to. He could go pirogue and go chill at the four seasons of Maui. But see, one person I respect and one person I don’t.
Lex Fridman
So his heart is in the right place fighting in this case for this ideal of the freedom of expression.
George Hotz
Well, I wouldn’t define the ideal so simply. I think you can define the ideal no more than just saying Elon’s idea of a good world, freedom of expression is.
Lex Fridman
But it’s still the downsides of that is the monarchy.
George Hotz
Yeah. I mean monarchy has problems, right? But I mean, would I trade right now the current oligarchy which runs America for the monarchy? Yeah, I would. Sure. For the Elon monarchy, yeah. You know why? Because power would cost 1 cent a kilowatt-hour, 10th of a cent a kilowatt-hour.
Lex Fridman
What do you mean?
George Hotz
Right now, I pay about 20 cents a kilowatt-hour for electricity in San Diego. That’s like the same price you paid in 1980. What the hell?
Lex Fridman
So you would see a lot of innovation with Elon.
George Hotz
Yeah. Maybe I’d have some hyperloops.
Lex Fridman
Yeah.
George Hotz
Right? And I’m willing to make that trade off. And this is why people think that dictators take power through some untoward mechanism. Sometimes they do, but usually it’s because the people want them. And the downsides of a dictatorship, I feel like we’ve gotten to a point now with the oligarchy wear. Yeah, I would prefer the dictator.
Lex Fridman
What’d you think about scholars, the programming language?
George Hotz
I liked it more than I thought. I did the tutorials. I was very new to it. It would take me six months to be able to write good scholar.
Lex Fridman
I mean, what did you learn about learning a new programming language from that?
George Hotz
I love doing new programming tutorials and doing them. I did all this for Rust. It keeps some of it’s upsetting JVM Roots, but it is a much nicer… In fact, I almost don’t know why Kotlin took off and not Scala. I think Scala has some beauty that Kotlin lacked, whereas Kotlin felt a lot more… I mean, I don’t know if it actually was a response to Swift, but that’s kind of what it felt like. Kotlin looks more like Swift and Scala looks more like a functional programming language, more like an OCaml or Haskell.
Lex Fridman
Let’s actually just explore. We touched it a little bit, but just on the art, the science and the art of programming. For you personally, how much of your programming is done with GPT currently?
George Hotz
None. I don’t use it at all.
Lex Fridman
Because you prioritize simplicity so much.
George Hotz
Yeah, I find that a lot of it as noise. I do use VS Code and I do like some amount of auto complete. I do like a very like, feels like rules based auto complete, an auto complete that’s going to complete the variable name for me. So I don’t just type it. I can just press tab. That’s nice. But I don’t want an auto complete. You know what I hate when auto completes, when I type the word four and it puts two parentheses and two semi cones and two braces? I’m like, “Oh man.”
Lex Fridman
Well, I mean, with the VS Code, and GPT, and with Codex, you can kind of brainstorm. I’m probably the same as you, but I like that it generates code and you basically disagree with it and write something simpler. But to me, that somehow is inspiring or makes me feel good. It also gamifies a simplification process. Because I’m like, “Oh yeah, you dumb AI system, you think this is the way to do it.” I have a simpler thing here.
George Hotz
It just constantly reminds me of bad stuff. I mean, I tried the same thing with rap, right? I tried the same thing with rap and I actually think I’m a much better programmer than rapper. But I even tried, I was like, “Okay, can we get some inspiration from these things for some rap lyrics?” And I just found that it would go back to the most cringy tropes and dumb rhyme schemes and I’m like, “Yeah, this is what the code looks like too.”
Lex Fridman
I think you and I probably have different threshold for cringe code. You probably hate cringe code.
George Hotz
Yeah.
Lex Fridman
I mean, boilerplate as a part of code, and some of it is just faster lookup. Because I don’t know about you, but I don’t remember everything. I’m offloading so much of my memory about different functions, library functions and all that kind of stuff. This GPT just is very fast at standard stuff, at standard library stuff, basic stuff that everybody uses.
George Hotz
Yeah. I don’t know. I mean, there’s just a little of this in Python. And maybe if I was coding more in other languages, I would consider it more. But I feel like Python already does such a good job of removing any boilerplate.
Lex Fridman
That’s true.
George Hotz
It’s the closest thing you can get to pseudocode, right?
Lex Fridman
Yeah, that’s true. That’s true.
George Hotz
And yeah, sure. If I like, “Yeah, I’m great GPT. Thanks for reminding me to free my variables.” Unfortunately, you didn’t really recognize the scope correctly and you can’t free that one, but you put the freeze there and I get it.
Lex Fridman
Fiverr, whenever I’ve used Fiverr for certain things like design or whatever, it’s always you come back. My experience with Fiverr is closer to your experience with programming. With GPT, it’s like you’re just frustrated and feel worse about the whole process of design and art and whatever I use five for. I’m using GPT as much as possible to just learn the dynamics of it, these early versions. Because it feels like in the future you’ll be using it more and more. For the same reason, I gave away all my books and switched to Kindle, because all right, how long are we going to have paper books? Like 30 years from now? I want to learn to be reading on Kindle even though I don’t enjoy it as much and you learn to enjoy it more. In the same way I switched from… Let me just pause. I switched from Emacs to VS Code.
George Hotz
Yeah. I switched from Vim to VS Code. I think similar, but…
Lex Fridman
Yeah, it’s tough. And that Vim to VS Code is even tougher because Emacs is old, more outdated, feels like it. The community is more outdated. Vim is like pretty vibrant still.
George Hotz
I never used any of the plugins. I still don’t use any of it. Yeah.
Lex Fridman
That’s why I looked at myself in the mirror. I’m like, “Yeah, you wrote some stuff in Lisp. Yeah.
George Hotz
No, but I never used any of the plugins in Vim either. I had the most vanilla Vim, I have a syntax eyeliner. I didn’t even have auto complete. These things I feel like help you so marginally. Now, VS Codes auto complete has gotten good enough, that I don’t have to set it up. I can just go into any code base and autocomplete’s right 90% of the time. Okay, cool. I’ll take it. Right? So, I don’t think I’m going to have a problem at all adapting to the tools once they’re good. But the real thing that I want is not something that like tab completes my code and gives me ideas. The real thing that I want is a very intelligent pair programmer that comes up with a little popup saying, “Hey, you wrote a bug on line 14 and here’s what it is.”
Lex Fridman
Yeah.
George Hotz
Now I like that. You know what does a good job at this? MyPie. I love MyPie. MyPie, this fancy type checker for Python. And actually, Microsoft released one too, and it was like 60% false positives. MyPie is like 5% false positives. 95% of the time, it recognizes. I didn’t really think about that typing interaction correctly. Thank you, MyPie.
Lex Fridman
So you type hinting, you like pushing the language towards being a typed language.
George Hotz
Oh yeah, absolutely. I think optional typing is great. I mean, look, I think that it’s a meet in the middle, right? Python has these optional type hinting and C++ has auto.
Lex Fridman
C++ allows you to take a step back.
George Hotz
Well, C++ would have you brutally type out SGD string iterator, right? Now, I can just type auto, which is nice. And then Python used to just have A. What type is A? It’s an A. A Colon str. Oh, okay. It’s a string. Cool.
Lex Fridman
Yeah.
George Hotz
I wish there was a way like a simple way in Python to turn on a mode which would enforce the types.
Lex Fridman
Yeah, like give a warning when there’s no type or something like this.
George Hotz
Well, no. Like MyPie was a static type checker, but I’m asking just for a runtime type checker. Like there’s ways to hack this in, but I wish it was just like a flag, like Python three dash T.
Lex Fridman
Oh, I see. Yeah, I see.
George Hotz
Enforce the types are on time.
Lex Fridman
Yeah. I feel like that makes you a better programmer. That’s the kind of test that the type remains the same.
George Hotz
Well, that I know, that I didn’t mess any types up. But again, MyPie’s getting really good and I love it, and I can’t wait for some of these tools to become AI powered. I want AI reading my code and giving me feedback. I don’t want AI’s writing half-assed autocomplete stuff for me.
Lex Fridman
I wonder if you can now take GPT and give it a code that you wrote for function and say, how can I make this simpler and have it accomplish the same thing? I think you’ll get some good ideas on some code. Maybe not the code you write for tinygrad type of code because that requires so much design thinking, but other kinds of code.
George Hotz
I don’t know. I downloaded the plugin maybe two months ago. I tried it again and found the same. Look, I don’t doubt that these models are going to first become useful to me, then be as good as me and then surpass me. But from what I’ve seen today, it’s like someone occasionally taking over my keyboard that I hired from Fiverr. Yeah, I’d rather not.
Lex Fridman
But ideas about how to debug the code or basically a better debugger is it? It is really interesting.
George Hotz
But it’s not a better debugger, that yes, I would love a better debugger.
Lex Fridman
Yeah, it’s not yet. Yeah. But it feels like it’s not too far.
George Hotz
Yeah. Yeah. One of my coworkers says he uses them for print statements like every time he has to, just when he needs. The only thing I can really write is like, okay, I just want to write the thing to print the state out right now.
Lex Fridman
Oh, that definitely is much faster is print statements. Yeah. I see in myself using that a lot just because it figures out what the rest of the function. You just say, “Okay, print everything.”
George Hotz
Yeah, print everything, right? And then if you want a pretty printer, maybe. I’m like, yeah, you know what? I think in two years, I’m going to start using these plugins a little bit. And then in five years, I’m going to be heavily relying on some AI augmented flow. And then in 10 years…
Lex Fridman
Do you think you’ll ever get to a hundred percent? What’s the role of the human that it converges to as a programmer?
George Hotz
Nothing.
Lex Fridman
So do you think it’s all generated?
George Hotz
I think it’s over for humans in general. It’s not just programming, it’s everything.
Lex Fridman
So niche becomes well…
George Hotz
Our niche becomes smaller and smaller and smaller. In fact, I’ll tell you what the last niche of humanity’s going to be.
Lex Fridman
Yeah.
George Hotz
There’s a great book. And if I recommended The Metamorphosis of Prime Intellect last time, there is a sequel called A Casino Odyssey in Cyberspace. And I don’t want to give away the ending of this, but it tells you what the last remaining human currency is, and I agree with that.
Lex Fridman
We’ll leave that as the cliffhanger. So no more programmers left, huh? That’s where we’re going.
George Hotz
Well, unless you want handmade code, maybe they’ll sell it on Etsy. This is handwritten code. It doesn’t have that machine polished to it. It has those slight imperfections that would only be written by a person.
Lex Fridman
I wonder how far away we are from that. I mean, there’s some aspect to… On Instagram, your title is listed as prompt engineer.
Prompt engineering
George Hotz
Right? Thank you for noticing. Yeah.
Lex Fridman
I don’t know if it’s ironic or non, or sarcastic or non. What do you think of prompt engineering as a scientific and engineering discipline and maybe art form?
George Hotz
You know what? I started comma six years ago and I started the Tiny Corp a month ago. So much has changed. I started going through similar comma processes to like starting a company. I’m like, okay, I’m going to get an office in San Diego. I’m going to bring people here. I don’t think so. I think I’m actually going to do remote, right? “George, you’re going to do remote? You hate remote.” Yeah. But I’m not going to do job interviews. The only way you’re going to get a job is if you contribute to the GitHub, right? And then interacting through GitHub, like GitHub being the real project management software for your company. And the thing pretty much just is a GitHub repo is like showing me what the future of… Okay, so a lot of times, I’ll go on Discord or kind of grad Discord. And I’ll throw out some random like, “Hey, can you change, instead of having log an X as LL lops, change it to log to an X2?”
It’s pretty small change. You can just change a base formula. That’s the kind of task that I can see in AI being able to do in a few years. In a few years, I could see myself describing that. And then within 30 seconds of pull request, it’s up that does it, and it passes my CI and I merge it, right? So I really started thinking about like what is the future of jobs? How many AIs can I employ at my company? As soon as we get the first tiny box up, I’m going to stand up a 65B LLaMA in the Discord. And it’s like, yeah, here’s the tiny box. He’s just like, he’s chilling with us.
Lex Fridman
Basically, like you said with niches, most human jobs will eventually be replaced with prompt engineering.
George Hotz
Well, prompt engineering kind of is this, as you move up the stack, there used to be humans actually doing arithmetic by hand. There used to be big farms of people doing pluses and stuff, right? And then you have spreadsheets, right? And then, okay, the spreadsheet can do the plus for me. And then you have macros, and then you have things that basically just are spreadsheets under the hood like accounting software. As we move further up the abstraction, well, what’s at the top of the abstraction stack? Well, prompt engineer.
Lex Fridman
Yeah.
George Hotz
What is the last thing if you think about humans wanting to keep control? Well, what am I really in the company, but a prompt engineer, right?
Lex Fridman
Isn’t there a certain point where the AI will be better at writing prompts?
George Hotz
Yeah. But you see the problem with the AI writing prompts, a definition that I always liked of AI was AI is the do what I mean machine. The computer is so pedantic. It does what you say, but you want the do what I mean, machine, right? You want the machine where you say, “Get my grandmother out of the burning house.” It reasonably takes your grandmother and puts her on the ground, not lifts her a thousand feet above the burning house and lets her fall. There’s no Zukowski examples.
Lex Fridman
But it’s not going to find the meaning. I mean, to do what I mean, it has to figure stuff out.
George Hotz
Sure.
Lex Fridman
And the thing you’ll maybe ask it to do is run government for me.
George Hotz
Oh, and do what I mean very much comes down to how aligned is that AI with you. Of course, when you talk to an AI that’s made by a big company in the cloud, the AI fundamentally is aligned to them, not to you. And that’s why you have to buy a tiny box. So you make sure the AI stays aligned to you. Every time that they start to pass AI regulation or GPU regulation, I’m going to see sales of tiny boxes spike. It’s going to be like guns. Every time they talk about gun regulation, boom. Gun sales.
Lex Fridman
So in the space of AI, you’re an anarchist, anarchism espouser, believer.
George Hotz
I’m an informational anarchist. Yes. I’m an informational anarchist and a physical status. I do not think anarchy in the physical world is very good because I exist in the physical world. But I think we can construct this virtual world where anarchy, it can’t hurt you. I love that Tyler, the creator tweet. It was, “Cyber bullying isn’t real, man. Have you tried? Turn it off the screen, close your eyes.”
Lex Fridman
Yeah. But how do you prevent the AI from basically replacing all human prompt engineers where nobody’s the prompt engineer anymore? So autonomy, greater and greater autonomy until it’s full autonomy. And that’s just where it’s headed. Because one person’s going to say, “Run everything for me.”
George Hotz
You see, I look at potential futures. And as long as the Ais go on to create a vibrant civilization with diversity and complexity across the universe, more power to them, we’ll die. If the AIs go on to actually turn the world into paperclips and then they die out themselves, well that’s horrific. And we don’t want that to happen. So this is what I mean about robustness. I trust robust machines. The current AIs are so not robust. This comes back to the idea that we’ve never made a machine that can self replicate. But if the machines are truly robust and there is one prompt engineer left in the world, hope you’re doing good, man. Hope you believe in God. Go by God and go forth and conquer the universe.
Video games
Lex Fridman
Well, you mentioned, because I talked to Mark about faith and God, and you said you were impressed by that. What’s your own belief in God and how does that affect your work?
George Hotz
I never really considered, when I was younger, I guess my parents were atheists, so I was raised kind of atheist. And I never really considered how absolutely silly atheism is because I create-
George Hotz
… really atheism is, because I create worlds. Every game creator, “How are you an atheist, bro? You create worlds.” “Well, [inaudible 02:40:10] but no one created the art world, man. That’s different. Haven’t you heard about the Big Bang and stuff?” Yeah. What’s the Skyrim myth origin story in Skyrim? I’m sure there’s some part of it in Skyrim, but it’s not like if you ask the creators… The Big Bang is in universe, right? I’m sure they have some Big Bang notion in Skyrim, right? But that obviously is not at all how Skyrim was actually created. It was created by a bunch of programmers in a room. So it struck me one day how just silly atheism is. Of course, we were created by God. It’s the most obvious thing.
Lex Fridman
That’s such a nice way to put it. We’re such powerful creators ourselves. It’s silly not to conceive that there’s creators even more powerful than us.
George Hotz
Yeah. And then I also like that notion. That notion gives me a lot of… I guess you can talk about what it gives a lot of religious people, it just gives me comfort. It’s like, “You know what? If we mess it all up and we die out, yeah.”
Lex Fridman
The same way that a video game has comfort in it.
George Hotz
God will try again.
Lex Fridman
Or there’s balance. Somebody figured out a balanced view of it, so it all makes sense in the end. A video game is usually not going to have crazy, crazy stuff.
George Hotz
People will come up with, ” Well, yeah, but man, who created God?” I’m like, “That’s God’s problem. What are you asking me? If God believes in God?”
Lex Fridman
I’m just this NPC living in his game.
George Hotz
I mean to be fair, if God didn’t believe in God, he’d be as silly as the atheists here.
Lex Fridman
What do you think is the greatest computer game of all time? Do you have any time to play games anymore? Have you played Diablo IV?
George Hotz
I have not played Diablo IV.
Lex Fridman
I will be doing that shortly. I have to. There’s just so much history with one, two, and three.
George Hotz
You know what? I’m going to say? World of Warcraft. And it’s not that the game is such a great game, it’s not. It’s that I remember, in 2005 when it came out, how it opened my mind to ideas. It opened my mind to this is whole world we’ve created. And there’s almost been nothing like it since. You can look at MMOs today, and I think they all have lower user bases than World of Warcraft. EVE Online’s kind of cool. But to think that everyone know … people are always like, “Look at the Apple headset.” What do people want in this VR? Everyone knows what they want. I want Ready Player One, and that…
So I’m going to say World of Warcraft, and I’m hoping that games can get out of this whole mobile gaming dopamine pump thing, and-
Lex Fridman
Create worlds.
George Hotz
Create worlds, yeah.
Lex Fridman
Worlds that captivate a very large fraction of the human population.
George Hotz
Yeah. And I think it’ll come back, I believe.
Lex Fridman
But MMO really, really pull you in.
George Hotz
Games do a good job. I mean okay, other two other games that I think are very noteworthy for me are Skyrim and GTA 5.
Lex Fridman
Skyrim, yeah. That’s probably number one for me. GTA… Hey, what is it about GTA? I guess GTA is real life. I know there’s prostitutes and guns and stuff.
George Hotz
Hey, they exist in real life too.
Lex Fridman
Yes, I know. But it’s how I imagine your life to be, actually.
George Hotz
I wish it was that cool.
Lex Fridman
Yeah. I guess because there’s Sims, right? Which is also a game I like, but it’s a gamified version of life. I would love a combination of Sims and GTA. So more freedom, more violence, more rawness, but with also ability to have a career and family and this kind of stuff.
George Hotz
What I’m really excited about in games is, once we start getting intelligent AIs to interact with. The NPCs in games have never been.
Lex Fridman
But conversationally, in every way.
George Hotz
Yeah, in every way. When you are actually building a world and a world imbued with intelligence.
Lex Fridman
Oh, yeah.
George Hotz
And it’s just hard. You know running World of Warcraft, you’re limited. You’re running on a penny and four. How much intelligence can you run? How many flops did you have? But now when I’m running a game on a hundred beta flop machine, what’s five people? I’m trying to make this a thing. 20 paid a flops of compute is one person of compute. I’m trying to make that a unit.
Lex Fridman
20 [inaudible 02:44:49] flops is one person.
George Hotz
One Person.
Lex Fridman
One person flop.
George Hotz
It’s like a horsepower. But what’s a horsepower? It’s how powerful a horse is. What’s a person of compute? Well, now you know-
Lex Fridman
[inaudible 02:44:58] flop. I got it. That’s interesting. VR also adds a… I mean in terms of creating worlds.
George Hotz
What a Quest 2. I put it on and I can’t believe, the first thing they show me is a bunch of scrolling clouds and a Facebook login screen. You had the ability to bring me into a world, and did you give me? A popup. Right. And this is why you’re not cool, Mark Zuckerberg. You could be cool. Just make sure on the Quest 3, you don’t put me into clouds in a Facebook login screen. Bring me to a world.
Lex Fridman
I just tried Quest 3. It was awesome. But hear that guys? I agree with that, so-
George Hotz
Wish it didn’t have this clouds in the… It was just so-
Lex Fridman
You know what? I mean, in the beginning, what is it, Todd Howard said this about design of the beginning of the games he creates is as like, “The beginning is so, so important.” I recently played Zelda for the first time, Zelda: Breath of the Wild, the previous one. And it’s very quickly; within 10 seconds, you come out of a cave type place and this world opens up. It’s like, “Hah.” And it pulls you in. You forget. Whatever troubles I was having, whatever…
George Hotz
I got to play that from the beginning. I played it for an hour at a friend’s house.
Lex Fridman
No, the beginning. They got it. They did it really well. The expansiveness of that space, the peacefulness of that place, they got this… the music mean. So much of that is creating that world and pulling you right in.
George Hotz
I’m going to go buy a Switch. I’m going to go today and buy a Switch.
Lex Fridman
You should. Well, the new one came out. I haven’t played that yet, but Diablo IV or something… I mean, there’s sentimentality also, but something about VR, really is incredible. But the new Quest 3 is mixed reality, and I got a chance to try that. So it’s augmented reality. And for video games, it’s done really, really well-
George Hotz
Is it passthrough or cameras?
Lex Fridman
Cameras.
George Hotz
It’s cameras. Okay.
Lex Fridman
Yeah.
George Hotz
The Apple one, is that one passthrough or cameras?
Lex Fridman
I don’t know. I don’t know how real it is. I don’t know anything
George Hotz
It’s coming out in January.
Lex Fridman
Is it January? Or is it some point?
George Hotz
Some point. Maybe not January. Maybe that’s my optimism. But Apple, I will buy it. I don’t care if it’s expensive and does nothing, I will buy it. I’ll support this future endeavor.
Lex Fridman
You’re the meme. Oh, yes. I support competition. It seemed like Quest was the only people doing it. And this is great that they’re like…
George Hotz
You know what? And this is another place we’ll give some more respect to Mark Zuckerberg. The two companies that have endured through technology are Apple and Microsoft. And what do they make? Computers and business services, right. All the meme, social ads, they all come and go. But you want to endure, build hardware.
Lex Fridman
Yeah. That’s a really interesting job. Maybe I’m new with this, but it’s a $500 headset, Quest 3. And just having creatures run around the space, our space right here, to me, okay, this is very boomer statement, but it added windows to the place.
George Hotz
Oh, I heard about the aquarium. Yeah.
Lex Fridman
Yeah, aquarium. But in this case, it was a zombie game, whatever, it doesn’t matter. But it modifies the space in a way where I can’t… it really feels like a window and you can look out. It’s pretty cool. It is like a zombie game. They’re running at me, whatever. But what I was enjoying is the fact that there’s a window and they’re stepping on objects in this space, that was a different kind of escape. Also, because you can see the other humans. So it’s integrated with the other humans. It’s really interesting-
George Hotz
And that’s why it’s more important than ever, that the AI is running on those systems are aligned with you. They’re going to augment your entire world.
Lex Fridman
Oh yeah. And those AIs have a… I mean, you think about all the dark stuff like sexual stuff. If those AIs threaten me, that could be haunting. If they threaten me in a non-video game way, it’s like…
George Hotz
Yeah, yeah, yeah, yeah.
Lex Fridman
They’ll know personal information about me. And then you lose track of what’s real, what’s not, what if stuff is hacked?
George Hotz
There’s two directions the AI girlfriend company can take, right. There’s the highbrow, something like her, maybe something you kind of talk to. And this is, and then there’s the lowbrow version of it, where I want to set up a brothel in Times Square.
Lex Fridman
Yeah.
George Hotz
Yeah. It’s not cheating if it’s a robot, it’s a VR experience.
Lex Fridman
Is there an in between?
George Hotz
No. I don’t want to do that one or that one.
Lex Fridman
Have you decided yet?
George Hotz
No. I’ll figure it out. We’ll see where the technology goes.
Lex Fridman
I would love to hear your opinions for George’s third company. What to do, the brothel on Times Square or The Hurt Experience? What do you think company number four will be? You think there’ll be a company number four?
George Hotz
There’s a lot to do in company number two. I’m talking about company number three now. None of that tech exists yet. There’s a lot to do in company number two. Company number two is going to be the great struggle of the next six years. And if the next six years, how centralized is compute going to be. The less centralized compute is going to be, the better of a chance we all have.
Lex Fridman
So you’re like a flag bearer for open source distributed cent decentralization of compute?
George Hotz
We have to. We have to, or they will just completely dominate us. I showed a picture on stream, of a man, in a chicken farm. You ever seen one of those factory farm, chicken farms? Why does he dominate all the chickens? Why does he-
Lex Fridman
Smarter.
George Hotz
He’s smarter, right. Some people on Twitch were like, “He’s bigger than the chickens.” Yeah. And now here’s a man in a cow farm, right. So it has nothing to do with their size and everything to do with their intelligence. And if one central organization has all the intelligence, you’ll be the chickens and they’ll be the chicken man. But if we all have the intelligence, we’re all the chickens. We’re not all the men, we’re all the chickens. There’s no chicken man.
Lex Fridman
There’s no chicken man. We’re just chickens in Miami.
George Hotz
He was having a good life, man.
Lex Fridman
Yeah, I’m sure he was. I’m sure he was. What have you learned from launching a running Comma AI in Tiny Corp? Starting a company from an idea and scaling it. And by the way, I’m all in on Tiny Box, so I’m your… I guess it’s pre-order only now.
George Hotz
I want to make sure it’s good. I want to make sure that the thing that I deliver is not going to be a Quest 2, which you buy and use twice. I mean, it’s better than a Quest which you bought and used less than once. Statistically.
Lex Fridman
Well, if there’s a beta program for Tiny Box, I’m into-
George Hotz
Sounds good.
Lex Fridman
So I won’t be the whiny… Yeah, I’ll be the tech-savvy user of the Tiny Box, just to be in the early days-
George Hotz
What have I learned?
Lex Fridman
What have you learned from building these companies?
George Hotz
The longest time at Comma, I asked, “Why? Why did I start a company? Why did I do this?” But what else was I going to do?
Lex Fridman
So you like bringing ideas to life?
George Hotz
With Comma, it really started as an ego battle with Elon. I wanted to beat him. I saw a worthy adversary. Here’s a worthy adversary who I can beat at self-driving cars. And I think we’ve kept pace, and I think he’s kept ahead. I think that’s what’s ended up happening there. But I do think Comma is… I mean, Comma’s profitable. And when this drive GPT stuff starts working, that’s it. There’s no more bugs in a loss function. Right now, we’re using a hand coated simulator. There’s no more bugs. This is going to be it. This is their run-up to driving.
Lex Fridman
I hear a lot of props for openpilot for Comma.
George Hotz
It’s better than FSD and autopilot in certain ways. It has a lot more to do with which field you like. We lowered the price on the hardware to 1499. You know how hard it is to ship reliable consumer electronics that go on your windshield? We’re doing more than most cell phone companies.
Lex Fridman
How’d you pull that off, by the way? Shipping a product that goes in a car?
George Hotz
I know. I have an SMT line. I make all the boards, in-house, in San Diego.
Lex Fridman
Quality control-
George Hotz
I care immensely about it. Actually our-
Lex Fridman
You’re basically a mom and pap shop with great testing.
George Hotz
Our head of openpilot is great at, “Okay, I want all the Comma 3s to be identical.” Yeah, I mean… Look, it’s 1499, 30-day money back, guaranteed. It will blow your mind at what it can do.
Lex Fridman
Is it hard to scale?
George Hotz
You know what? There’s kind of downsides to scaling it. People are always like, “Why don’t you advertise?” Our mission is to solve self-driving cars while the deliver shippable intermediaries. Our mission has nothing to do with selling a million boxes. It’s [inaudible 02:54:00].
Lex Fridman
Do you think it’s possible that Comma gets sold?
George Hotz
Only if I felt someone could accelerate that mission and wanted to keep it open source. And not just wanted to. I don’t believe what anyone says. I believe incentives. If a company wanted to buy Comma with their incentives, were to keep it open source. But comma doesn’t stop at the cars. The cars are just the beginning. The device is a human head. The device has two eyes, two ears, it breathes air, it has a mouth.
Lex Fridman
So you think this goes to embodied robotics?
George Hotz
Well sell Common bodies too. They’re very rudimentary. But one of the problems that we are running into, is that the Comma 3 has about as much intelligence as a bee. If you want a human’s worth of intelligence, you’re going to need a tiny rack, not even a tiny box, you’re going to need a tiny rack, maybe even more.
Lex Fridman
How do you put legs on that?
George Hotz
You don’t. And there’s no way you can. You connect to it wirelessly. So you put your tiny box or your tiny rack in your house, and then you get your Comma body and your Comma body runs the models on that. It’s close. You don’t have to go to some cloud, which is 30 milliseconds away. You go to a thing which is 0.1 milliseconds away.
Lex Fridman
So the AI girlfriend will have a central hub in the home?
George Hotz
I mean, eventually. If you fast-forward 20, 30 years, the mobile chips will get good enough to run these Ais. But fundamentally, it’s not even a question of putting legs on a tiny box, because how are you getting 1.5 kilowatts of power on that thing? Right? So they’re very synergistic businesses. I also want to build all of Comma’s training computers. Right. Comma builds training computers. Right now we use commodity parts. I think I can do it cheaper. So we’re going to build. Tiny Corp is going to not just sell tiny boxes. Tiny boxes is the consumer version. But I’ll build training data centers too.
Andrej Karpathy
Lex Fridman
Have you talked to Andre Kaparthy or have you talked to Elon about Tiny Corp?
George Hotz
He went to work at OpenAI.
Lex Fridman
What do you love about Andre Kaparthy? To me, he’s one of the truly special humans we got.
George Hotz
Oh man. His streams are just a level of quality so far beyond mine. I can’t help myself. It’s just…
Lex Fridman
Yeah, he’s good.
George Hotz
He wants to teach you. I want to show you that I’m smarter than you.
Lex Fridman
Yeah, he has no… I mean, thank you for the sort of the raw, authentic honesty. Yeah. I mean, a lot of us have that. I think Andre is as legit as it gets in that he just wants to teach you. And there’s a curiosity that just drives him. At the stage where he is in life, to be still one of the best tinkerers in the world. It’s crazy, to, what is it? Micrograd?
George Hotz
Micrograd was… Yeah, inspiration for tinygrad. The whole… I mean, his CS231n was… this was the inspiration. This is what I just took and ran with and ended up writing this, so..
Lex Fridman
But I mean, to me that-
George Hotz
Don’t go work for Darth Vader, man.
Lex Fridman
I mean, the flip side, to me, is the fact that he’s going there, is a good sign for OpenAI. I think I like [inaudible 02:57:21] discover a lot. Those guys are really good at what they do.
George Hotz
I know they are. And that’s what’s even more… And you know what? It’s not that OpenAI doesn’t open source the weights of GPT-4. It’s that they go in front of Congress. And that is what upsets me. We had two effective altruists [inaudible 02:57:41] go in front of Congress. One’s in jail.
Lex Fridman
I think you’re drawing parallels on there.
George Hotz
One’s in jail.
Lex Fridman
You gave me a look. You gave me a look.
George Hotz
No, I think a factor of altruism is a terribly evil ideology and yeah.
Lex Fridman
Oh yeah. That’s interesting. Why do you think that is? Why you think there’s something about a thing that sounds pretty good, that kind of gets us into trouble?
George Hotz
Because you get [inaudible 02:58:06] freed. [inaudible 02:58:07] freed is the embodiment of effective altruism. Utilitarianism is an abhorrent ideology. Well, yeah, we’re going to kill those three people to save a thousand, of course, right. There’s no underlying, there’s just.. Yeah.
Lex Fridman
Yeah. But to me that’s a bit surprising. But it’s also, in retrospect, not that surprising. But I haven’t heard really clear kind of rigorous analysis why effective altruism is flawed.
George Hotz
Oh well, I think charity is bad, right. So what is charity but investment that you don’t expect to have a return on? Right.
Lex Fridman
But you can also think of charity as you would like to see… So allocate resources in optimal way to make a better world.
George Hotz
And probably almost always, that involves starting a company, right, because-
Lex Fridman
More efficient,-
George Hotz
If you just take the money and you spend it on malaria nets, okay, great. You’ve made a hundred malaria nets. But if you teach-
Lex Fridman
A man, how to fish.
George Hotz
Right?
Lex Fridman
Yeah. No, but the problem is teaching amount how to fish might be harder. Starting a company might be harder than allocating money that you already have.
George Hotz
I like the flip side of effective altruism; effective accelerationism. I think accelerationism is the only thing that’s ever lifted people out of poverty. The fact that food is cheap. Not, “We’re giving food away because we are kindhearted people.” No, food is cheap. And that’s the world you want to live in. UBI, what a scary idea. What a scary idea. All your power now? If money is power, your only source of power is granted to you by the goodwill of the government. What a scary idea.
Lex Fridman
So you even think long term, even-
George Hotz
I’d rather die than need UBI to survive. And I mean it.
Lex Fridman
What if survival is basically guaranteed? What if our life becomes so good?
George Hotz
You can make survival guaranteed without UBI. What you have to do, is make housing and food dirt cheap. Right? And that’s the good world. And actually, let’s go into what we should really be making dirt cheap, which is energy. Right. That energy that… Oh my God, that’s…
I’m pretty centrist politically. If there’s one political position I cannot stand, it’s deceleration. It’s people who believe we should use less energy. Not people who believe global warming is a problem, I agree with you. Not people who believe that the saving the environment is good, I agree with you. But people who think we should use less energy, that energy usage is a moral bad. No, no. You are asking, you are diminishing humanity.
Lex Fridman
Yeah. Energy is flourishing. Creative flourishing of the human species.
George Hotz
How do we make more of it? How do we make it clean? And how do we make… How I pay 20 cents for a megawatt hour instead of a kilowatt hour?
Lex Fridman
Part of me wishes that Elon went into nuclear fusion versus Twitter, part of me. Or somebody like Elon.
George Hotz
I wish there were more Elons in the world. And I think Elon sees it as this is a political battle that needed to be fought. And again, I always ask the question of whenever I disagree with him, I remind myself that he is a billionaire and I’m not. So maybe he’s got something figured out that I don’t, or maybe he doesn’t
Lex Fridman
To have some humility. But at the same time, me as a person who happens to know him, I find myself in that same position. And sometimes even billionaires need friends who disagree and help them grow. And that’s a difficult reality.
George Hotz
And it must be so hard. It must be so hard to meet people once you get to that point where-
Lex Fridman
Fame, power, money, everybody’s sucking up to you.
George Hotz
See, I love not having shit. I don’t have shit man. Trust me. There’s nothing I can give you. There’s nothing worth taking from me.
Lex Fridman
Yeah. It takes a really special human being, when you have power, when you have fame, when you have money, to still think from first principles. Not all the adoration you get towards you, all the admiration, all the people saying, “Yes, yes, yes.”
George Hotz
And all the hate too.
Lex Fridman
And the hate-
George Hotz
I think that’s worse.
Lex Fridman
So the hate makes you want to go to the ‘yes’ people because the hate exhausts you. And the kind of hate that Elon’s gotten from the left, is pretty intense. And so that, of course, drives him right, and loses balance, and-
George Hotz
And it keeps this absolutely fake siop political divide alive, so that the 1% can keep power.
Lex Fridman
I wish we would be less divided because it is giving powr-
George Hotz
It gives power-
Lex Fridman
To the ultra powerful.
George Hotz
I know.
Lex Fridman
The rich get richer. You have love in your life. Has love made you a better or a worse programmer? Do you keep productivity metrics?
George Hotz
No, no, no. I’m not that methodical. I think there comes to a point where, if it’s no longer visceral, I just can’t enjoy it. I guess still, viscerally, love programming. The minute I started-
Lex Fridman
So that’s one of the big loves of your life, is programming?
George Hotz
I mean, just my computer in general. I mean, I tell my girlfriend, “My first love is my computer,” of course. I sleep with my computer. It’s there for a lot of my sexual experiences. Come on. So is everyone’s right. You got to be real about that. And-
Lex Fridman
Not just the ID for programming, just the entirety of the computational machine?
George Hotz
The fact that… Yeah. I wish it was a.. And someday they’ll be smarter, and someday [inaudible 03:03:59]. Maybe I’m weird for this, but I don’t discriminate, man. I’m not going to discriminate BioStack life in Silicon Stack life.
Lex Fridman
So the moment the computer starts to say, “I miss you,” and starts to have some of the basics of human intimacy, it’s over for you. The moment VS Code says, “Hey, George…”
George Hotz
No, no, no, but VS Code is… No, Microsoft’s doing that to try to get me hooked on it. I’ll see through it. I’ll see through it. It’s gold digger, man. It’s gold digger.
Lex Fridman
Well, it can be an open source thing.
George Hotz
Well, this just gets more interesting, right. If it’s open source, then yeah, it becomes-
Lex Fridman
Though, Microsoft’s done a pretty good job on that.
George Hotz
Oh, absolutely. No, no, no. Look, I think Microsoft… Again, I wouldn’t count on it to be true forever, but I think right now, Microsoft is doing the best work in the programming world, between GitHub, GitHub Actions VS Code, the improvements to Python, it was Microsoft.This is-
Lex Fridman
Who would’ve thought, Microsoft and Mark Zuckerberg are spearheading the open source movement.
George Hotz
Right? Right? How things change.
Lex Fridman
Oh, it’s beautiful.
George Hotz
And by the way, that’s who I bet on to replace Google, by the way.
Lex Fridman
Who?
George Hotz
Microsoft.
Lex Fridman
Microsoft.
George Hotz
I think Satya Nadella said straight up, “I’m coming for it.”
Lex Fridman
Interesting. So your bet, who wins AGI? That’s [inaudible 03:05:16]-
George Hotz
I don’t know about AGI. I think we’re a long way away from that. But I would not be surprised, if in the next five years, Bing overtakes Google as a search engine.
Lex Fridman
Interesting.
George Hotz
Wouldn’t surprise me.
Lex Fridman
Interesting. I hope some startup does.
George Hotz
It might be some startup too. I would equally bet on some startup.
Lex Fridman
Yeah. I’m like 50 50. But maybe that’s naive. I believe in the power of these language models.
George Hotz
Satya is alive. Microsoft’s alive.
Lex Fridman
Yeah, it’s great. It’s great. I like all the innovation in these companies. They’re not being stale, and to the degree they’re being stale, they’re losing. So there’s a huge incentive to do a lot of exciting work and open source work, this is incredible.
George Hotz
Only way to win.
Meaning of life
Lex Fridman
You’re older, you’re wiser. What’s the meaning of life, George Hotz?
George Hotz
To win.
Lex Fridman
It’s still to win?
George Hotz
Of course.
Lex Fridman
Always?
George Hotz
Of course.
Lex Fridman
What’s winning look like for you?
George Hotz
I don’t know. I haven’t figured out what the game is yet, but when I do, I want to win-
Lex Fridman
So it’s bigger than solving self-driving? It’s bigger than democratizing, decentralizing and compute?
George Hotz
I think the game is to stand eye to eye with God.
Lex Fridman
I wonder what that means for you. At the end of your life, what that would look like.
George Hotz
I mean, this is what… I don’t know. There’s probably some ego trip of mine. “You want to stand eye to eye with God. You’re just blasphemous, man.” Okay. I don’t know. I don’t know. I don’t know. I don’t know if it would upset God. I think he wants that. I mean, I certainly want that from my creations. I want my creations to stand eye to eye with me. So why wouldn’t God want me to stand eye to eye with him? That’s the best I can do, golden rule.
Lex Fridman
I’m just imagining the creator of a video game, having to look, stand eye to eye, with one of the characters.
George Hotz
I only watched season one of Westworld. But yeah, we got to find the maze and solve it.
Lex Fridman
Yeah. I wonder what that looks like. It feels like a really special time in human history, where that’s actually possible. There’s something about AI that’s… we’re playing with something weird here. Something really weird.
George Hotz
I wrote a blog post, “I reread Genesis and just looked like… they give you some clues at the end of Genesis for finding the Garden of Eden. And I’m interested. I’m interested.”
Lex Fridman
Well, I hope you find just that, George, you’re one of my favorite people. Thank you for doing everything you’re doing and in this case, for fighting for open source or for decentralization of AI. It’s a fight worth fighting, fight worth winning, hashtag. I love you, brother. These conversations are always great. Hope to talk to you many more times. Good luck with Tiny Corp.
George Hotz
Thank you. Great to be here.
Lex Fridman
Thanks for listening to this conversation with George Hotz. To support this podcast, please check out our sponsors in the description. And now, let me leave you with some words from Albert Einstein, “Everything should be made as simple as possible, but not simpler.” Thank you for listening and hope to see you next time.