Added support for 8ch.net and yuki.la in ChanRipper.java

[infamix]

Category

This change is exactly one of the following (please change [ ] to [x]) to indicate which:

• a bug fix (Fix #...)
• a new Ripper
• a refactoring
• a style change/fix

Description

I've added support for 8chan (8ch.net) and yuki.la 4chan archive threads in ChanRipper,
which were missing.

Testing

Required verification:

• I've verified that there are no regressions in mvn test (there are no new failures or errors).
• I've verified that this change works as intended.
  • Downloads all relevant content.
  • Downloads content from multiple pages (as necessary or appropriate).
  • Saves content at reasonable file names (e.g. page titles or content IDs) to help easily browse downloaded content.
• I've verified that this change did not break existing functionality (especially in the Ripper I modified).

Optional but recommended:

• I've added a unit test to cover my change.

[cyian-1756]

|| url.toExternalForm().contains("/"); // yuki.la, etc is way to greedy. Try changing it to a regex that will only match yuki.la links.

[rudolphos]

I have a request and I didn't want to make a new request thread. But would it be possible to add way to download images/videos with original image names instead of numbers?

DL from https://media.8ch.net/xxx/file_dl/xxx.jpg/xxx.jpg instead of https://media.8ch.net/xxx/src/xxx.jpg

file_dl has original file names, but /src/ serves images with number file names.

@infamix also a ripper for 4plebs.org would be great.

[cyian-1756]

@rudolphos

But would it be possible to add way to download images/videos with original image names instead of numbers?

Yea it could.