Skip to content

Minecraft Enthusiast Creates Unique AI Model, CraftGPT

CraftGPT is a groundbreaking AI model built entirely within Minecraft. It's slow, but it's a remarkable feat of creativity and technical skill.

In this image there is a table with many cores, a laptop, a pen and a few things on it.
In this image there is a table with many cores, a laptop, a pen and a few things on it.

Minecraft Enthusiast Creates Unique AI Model, CraftGPT

A Minecraft enthusiast, Sammyuri, has created a unique language model called CraftGPT. Unlike typical chatbots, CraftGPT is built within the Minecraft world using Redstone engineering, showcasing an innovative blend of gaming and AI.

CraftGPT is a small model with 5,087,280 parameters, an embedding dimension of 240, and a vocabulary of 1920 tokens. It consists of 6 layers and has a context window size of 64 tokens, with most weights quantized to 8 bits. The model is trained on the TinyChat dataset and functions as intended, but response times are lengthy, taking about two hours for a simple prompt even with optimizations like MCHPRS.

The project is a massive structure in Minecraft, comprising 1,020 x 260 x 1,656 blocks, totaling 439 million blocks. Sammyuri used Redstone components, such as dust, repeaters, comparators, and pistons, to physically encode the neural network's operations. This unique approach allows CraftGPT to run within the Minecraft environment, demonstrating Sammyuri's creativity and technical prowess.

CraftGPT, while not a rival to everyday chatbot sites due to response time limitations, is a remarkable achievement in AI and Minecraft integration. Sammyuri's project showcases the potential of Redstone engineering in creating functional AI models within a gaming environment. The model's slow response time is a challenge, but it doesn't diminish the innovation and creativity of the CraftGPT project.

Read also:

Latest