GPT2_Replication

Built GPT-2 from scratch

Data Used

I trained and tested on various data from reddit, a curated QA dataset and the classic tiny_shakespeare dataset from Andre Karpathy.

Name		Name	Last commit message	Last commit date
Latest commit History 21 Commits
__pycache__		__pycache__
data		data
.gitignore		.gitignore
README.md		README.md
inference.py		inference.py
input.txt		input.txt
model.ipynb		model.ipynb
model.py		model.py
test.py		test.py
train.py		train.py