Skip to content

Latest commit

 

History

5 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

webnovel_crawler

一个模仿阅读自动爬取目标网站在线小说存为txt文档的爬虫,随机选的网站 仅供学习交流编程使用
Require python 3.6 and above 需要安装python3.6以上 https://www.python.org/downloads/
Require selenium 需要安装selenium模组 https://www.seleniumhq.org Require beautifulsoup 需要安装beautifulsoup模组 https://www.crummy.com/software/BeautifulSoup/? Require requests 需要安装requests模组 http://docs.python-requests.org/en/master/ 如果已经安装了python3.6 window用户可以通过pip install selenium来安装selenium/requests/beautifulsoup
如果已经安装了python3.6的mac和Linux用户可以通过pip3 install selenium来安装selenium/requests/beautifulsoup
项目自带了windows系统的chrome driver. Mac和linux用户需要下载自己对应版本的chrome driver放入根目录中并将主程序文件中第十三行的'chromedriver.exe'替换成对应版本的驱动器文件名

example

About

Online noverl_crawler. Simulating online browsing behaviour to crawl a target website's novel content.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages