Export desired amount of posts from specified subreddit and category/sort without any API wrappers
-
Updated
Aug 7, 2023 - Go
Export desired amount of posts from specified subreddit and category/sort without any API wrappers
Surfer User-Agent (surferua) is a lightweight and high performance Golang package that generate HTTP User-Agent strings with particular attention to device type. 高性能 Golang 爬虫浏览器随机库。
Flexible and concurrent web crawler implemented in 'go'
A Go utility that crawls documentation websites and packages them into an offline bundle with full-text search capabilities. Built with Go's HTTP client and HTML parsing, featuring deterministic builds and content deduplication. A tool for bundling online documentation into offline, searchable archives.
Eitaa Extractor is a Go-based web scraper designed to extract posts from Eitaa channels. It retrieves post details such as text, images, videos, timestamps, and metadata (e.g., forwarded or reply information) and saves them to a JSON file. The project includes Docker and Docker Compose configurations for easy deployment.
Add a description, image, and links to the go-crawler topic page so that developers can more easily learn about it.
To associate your repository with the go-crawler topic, visit your repo's landing page and select "manage topics."