Webscraper

Template for web-scraping PDF documents

Prerequisites

1. urllib

Installing urllib:

pip3 install urllib3 

Using webscraper

To use webscraper, fork this repository and clone it to your local system. I recommend the following:

1. Change directory into your Desktop

cd Desktop

2. Initialize a Git repository in Desktop

git init

3. Clone the repository (example given below)

git clone https://github.com/beomjin-lee/webscraper.git

4. Change directory into the repository

cd webscraper

5. Edit the code to suit your needs with URL, and the number of articles you wish to scrape

6. Run the code

python3 webscrape.py