Knowledge Base

Curated X posts, YouTube videos, repositories and articles on AI, web development and design. Updated every day, summarised by AI and searchable with AI search.

2 entries

Keyword: nanogpt

  • Repository:karpathy/nanoGPT

    nanoGPT: Minimalist Repository for Training and Fine-Tuning GPTs

    nanoGPT by Andrej Karpathy is a lean and fast codebase designed for training and fine-tuning medium-sized GPT models in PyTorch. Developed as a rewrite of minGPT, it can reproduce GPT-2 (124M). As of November 2025, the repository is officially marked as deprecated by the author, who recommends nanochat instead.

    62.8kstarsPython

    From X post: Weekend Project: Training a GPT-2-Level Model from Scratch

    AI & LLMs· Resource

  • X post:0xSero

    Weekend Project: Training a GPT-2-Level Model from Scratch

    In a post on X, 0xSero outlines a weekend project aimed at training a GPT-2-level language model using Python. According to the author, the setup requires around 4 to 8 hours and roughly $50 in compute costs, leveraging Andrej Karpathy's educational resources.

    1.2kbookmarks69.1kviews

    AI & LLMs· Resource

2 of 2 shown

Suggest Content

Do you have an interesting article, a video, or a tweet that belongs in our knowledge base? Write to us at office@webconsulting.at.

Let's talk about your project

Get in touch

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.