MMM-scrape

This is a Magic Mirror Module which loads parts of a remote website based on a CSS selector. It uses JSDOM to load an external URL, and then Selectors to scrape the contents of interest.

Useful for fetching content from sources without APIs.

Mostly written by @sdetweil - many thanks.

Installation

1. Clone this repo into ~/MagicMirror/modules directory.
2. Run command npm install in ~/MagicMirror/modules/MMM-scrape directory, to install all dependencies.
3. Configure your ~/MagicMirror/config/config.js:

    {
        module: 'MMM-scrape',
        position: 'top_left',
        config: {
                url: "https://termine.orf.at/fm4/",
                domselector: ".eventTitle, .eventDate",
                loadScripts: "false"
                }
    },

Config Options

Option	Default	Description
url	'https://termine.orf.at/fm4'	The URL of the Site from which content should be scraped
domselector	h1	The CSS Selector for the content which should be extracted from the site
loadScripts	false	Telling jsdom to load external scripts - Warning - only use with trusted sites!