Skip to content

nomomon/Amazon-Product-Description

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Amazon Description Generator

cover

AI that generates Amazon-style product descriptions using a fine-tuned GPT-Neo model. Built as a proof of concept for Texta.ai.

What's this about

The founder of Texta.ai reached out — they were using GPT-3 to generate product descriptions but it was too expensive. I built a cheaper alternative by fine-tuning GPT-Neo on scraped Amazon product data.

Started with Puppeteer scraping from Amazon directly, but it was painfully slow. Switched to a pre-scraped dataset from UCSD. Cleaned the data, shaped it into prompt templates, and fine-tuned multiple models using HappyTransformer on Google Colab.

There are 4 model variants (0–3), each trained progressively longer. Model 3 gives the best results.

How to launch

pip install happytransformer

Then open the notebook:

jupyter notebook Texta_ai_Amazon_gpt_neo.ipynb

Download models from Google Drive or use the ones in this repo. Point load_path to your chosen model directory.

Video tutorial (in Russian)

About

Amazon product description generator using fine-tuned GPT-Neo — proof of concept for Texta.ai

Topics

Resources

License

Stars

Watchers

Forks