LLMs must one day run in Space

https://twitter.com/karpathy/status/1786085254006202541

user avatar

Clearly LLMs must one day run in Space Step 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space. en.wikipedia.org/wiki/The_Power… (see the linked PDF) LLM training/inference in principle should be super safe - it is just one fixed array of floats, and a single, bounded, well-defined loop of dynamics over it. There is no need for memory to grow or shrink in undefined ways, for recursion, or anything like that. Step 2 we've already sent messages out to Space, for possible consumption by aliens, e.g. see: Arecibo message, beamed to space: en.wikipedia.org/wiki/Arecibo_m… Voyager golden record, attached to probe: en.wikipedia.org/wiki/Voyager_G… The Three Body problem (ok bad example) But instead of sending any fixed data, we could send the weights of an LLM packaged in the llm.c binary, with instructions for the machine code. The LLM would then "wake up" and interact with the aliens on behalf of the human race. Maybe one day we'll ourselves find LLMs of aliens out there, instead of them directly. Maybe the LLMs will find each other. We'd have to make sure the code is really good, otherwise that would be kind of embarrassing. :) Step 2 is clearly not a serious proposal it's just fun to think about. Step 1 is a serious proposal as, clearly, LLMs must one day run in Space.

{
"by": "tosh",
"descendants": 1,
"id": 40246404,
"kids": [
40246594
],
"score": 6,
"time": 1714735449,
"title": "LLMs must one day run in Space",
"type": "story",
"url": "https://twitter.com/karpathy/status/1786085254006202541"
}
{
"author": "Andrej Karpathy",
"date": "2024-05-02T17:28:03.000Z",
"description": "Clearly LLMs must one day run in Space Step 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space.\nhttps://t.co/tYGrfdka4X (see the linked PDF)\nLLM training/inference in principle should be super",
"image": "https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_200x200.jpg",
"logo": null,
"publisher": "Twitter",
"title": "Andrej Karpathy (@karpathy) on X",
"url": "https://x.com/karpathy/status/1786085254006202541"
}
{
"url": "https://x.com/karpathy/status/1786085254006202541",
"title": "Andrej Karpathy (@karpathy) on X",
"description": "Clearly LLMs must one day run in Space\n\nStep 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space.\nhttps://t.co/tYGrfdka4X (see the linked PDF)\nLLM training/inference in principle should be super",
"links": [
"https://x.com/karpathy/status/1786085254006202541",
"https://twitter.com/karpathy/status/1786085254006202541"
],
"image": "https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_200x200.jpg",
"content": "<div><div><p><a target=\"_blank\" href=\"https://x.com/karpathy\"><img alt=\"user avatar\" src=\"https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_normal.jpg\" srcset=\"https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_mini.jpg 24w, https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_normal.jpg 48w, https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_bigger.jpg 73w, https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_x96.jpg 96w, https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_200x200.jpg 200w, https://pbs.twimg.com/profile_images/1296667294148382721/9Pr6XrPB_400x400.jpg 400w\" /></a></p></div><div><p><span>Clearly LLMs must one day run in Space\nStep 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space.\n</span><a href=\"https://en.wikipedia.org/wiki/The_Power_of_10:_Rules_for_Developing_Safety-Critical_Code\" target=\"_blank\">en.wikipedia.org/wiki/The_Power…</a><span> (see the linked PDF)\nLLM training/inference in principle should be super safe - it is just one fixed array of floats, and a single, bounded, well-defined loop of dynamics over it. There is no need for memory to grow or shrink in undefined ways, for recursion, or anything like that.\nStep 2 we've already sent messages out to Space, for possible consumption by aliens, e.g. see:\nArecibo message, beamed to space:\n</span><a href=\"https://en.wikipedia.org/wiki/Arecibo_message\" target=\"_blank\">en.wikipedia.org/wiki/Arecibo_m…</a><span>\nVoyager golden record, attached to probe:\n</span><a href=\"https://en.wikipedia.org/wiki/Voyager_Golden_Record\" target=\"_blank\">en.wikipedia.org/wiki/Voyager_G…</a><span>\nThe Three Body problem (ok bad example)\nBut instead of sending any fixed data, we could send the weights of an LLM packaged in the llm.c binary, with instructions for the machine code. The LLM would then \"wake up\" and interact with the aliens on behalf of the human race. Maybe one day we'll ourselves find LLMs of aliens out there, instead of them directly. Maybe the LLMs will find each other. We'd have to make sure the code is really good, otherwise that would be kind of embarrassing.\n:) Step 2 is clearly not a serious proposal it's just fun to think about. Step 1 is a serious proposal as, clearly, LLMs must one day run in Space.</span></p></div></div>",
"author": "",
"favicon": "https://x.com/favicon.ico",
"source": "x.com",
"published": "",
"ttr": 47,
"type": "article"
}