nutanixdev / nugpt Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Codebase for developing a miniaturized GPT model, following GPT-2 architecture

Apache-2.0 license

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
data		data
LICENSE		LICENSE
README.md		README.md
configurator.py		configurator.py
model.py		model.py
requirements.txt		requirements.txt
sample.py		sample.py
train.py		train.py

Repository files navigation

nugpt

This repo includes pertinent codebase for developing a miniaturized GPT model. It follows GPT-2 architecture.

Commands

Data Engineering

Include text data
run: python data/data/prepare.py

Model Training

python train.py --batch_size=32 --wandb_log=True

Inference

python sample.py --out_dir=out-wiki

About

Codebase for developing a miniaturized GPT model, following GPT-2 architecture

Apache-2.0 license

Custom properties

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%