Skip to content
GitHub Universe 2025
Last chance: Save $400 on Universe passes until 9/17. Register now
#

from-scratch-in-python

Here are 25 public repositories matching this topic...

This repository explores building a character-level transformer decoder in PyTorch, similar to GPT while focusing more on understanding individual components. My goal is to gain deep transformer knowledge and see if character-level learning improves handling of unseen words. The code allows for hyperparameter tuning and experiment customization.

  • Updated Aug 30, 2024
  • Jupyter Notebook

Disclaimer: The content of the repository is based on the tutorial made by Thibault Polge. My goal is just to learn more about Git. Every implementation was done NOT just by copying and pasting, but by trying to understand each line and each command that was being typed.

  • Updated Jul 5, 2025
  • Python

Improve this page

Add a description, image, and links to the from-scratch-in-python topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the from-scratch-in-python topic, visit your repo's landing page and select "manage topics."

Learn more