Skip to content

Rajadhurairajendhiran123/gpt_scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 

Repository files navigation

  1. Learned to build GPT-2 architecture from scratch, understanding each component like tokenization, attention, and transformer blocks.
  2. Gained hands-on experience in training language models using PyTorch and managing datasets efficiently.
  3. Explored key NLP concepts like positional encoding, causal masking, and text generation techniques.
  4. Developed debugging and optimization skills critical for real-world AI model deployment.
  5. This experience strengthens my profile for Generative AI, NLP engineering, and research-based AI product development roles.

About

Built GPT-2 from scratch using PyTorch, mastering transformers, attention, and tokenization. Gained hands-on NLP experience with text generation, causal masking, and model optimization. Strengthened skills for roles in Generative AI, NLP, and AI product development.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors