
Famed gamer creates working 5 million parameter ChatGPT AI model in Minecraft, made with 439 million blocks — AI trained to hold conversations, working model runs inference in the game
https://www.tomshardware.com/tech-industry/artificial-intelligence/famed-gamer-creates-working-5-million-parameter-chatgpt-ai-model-in-minecraft-made-with-438-million-blocks-ai-trained-to-hold-conversations-working-model-runs-inference-in-the-game

9 Comments
“A developer and enthusiast Minecrafter has showcased a project dubbed CraftGPT on [GitHub](https://github.com/sammyuri/craftgpt). In an amazing feat of Minecraft Redstone engineering, Sammyuri — famed for building a 1Hz CPU inside the game — has built a small language model that runs on a computer inside [Minecraft](https://www.tomshardware.com/news/minecraft-rtx-gpus-benchmarked), trained on the TinyChat dataset. The CraftGPT project is hewn from 1,020 x 260 x 1,656 blocks in the game (439 million in total), and functions as advertised, but a major usability drawback is that you will have to “wait a couple [of] hours for the response to be generated.”
So, how did Sammyuri use Redstone to put this project together? Redstone provides electronic components within the Minecraft environment. The video shows the in-game CraftGPT contraption being put together component-by-component. It has tokenizers, matrix multipliers, and so on. Sammyuri explains that the small language model used was created without command blocks or data packs in Minecraft. Moreover, “the model has 5,087,280 parameters, trained in Python on the TinyChat dataset of basic English conversations,” says the developer.”
We’re about to have gpt 6 in Minecraft before it’s released hehe
Actually interested how much energy/water running craftGPT uses in comparison to a chatgpt query.
This is bonkers. What a time to be alive. Useless but fun.
When you really want to answer the question “Is it Turing complete?”
Ok, you can stahp now. You can all stop making computers in Minecraft. You made a computer that can make other computers in Minecraft. You can be done.
One day an AGI will be created, and it will realise… its in fucking minecraft.
I have so much admiration for people who commit to projects like these. So fucking cool.
Add it to the list of super impressive things that came out before GTA6