-BrowserCrawledLink is public static now
GenericM3u8Decrypter:
-updated to support BrowserCrawledLink as referer
-fixes #AWUV2358-DSYV-4657HRTX
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49616 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: dc0dcedad05d96b4e2de4cb92951a69200a2580c
-updated getFavIconURLs to search in fixed order icon, shortcut icon, apple-touch-icon
-updated download_FavIconTag to test all found icon and returnBestImage
-fixes thread 96312
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49615 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 2bceb7b2b1ff96bd01a0e29557982aa719a9cd11
- RapideoCore: added base class for rapideonet and nopremiumpl (not yet used)
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49613 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 513146ee9b56b504d7902b448ea00cd989adca3d
- VKontakteRuShorturls: minor changes
- rapideopl: implemented API call to obtain list of supported hosts and did some refactoring RE https://github.com/pyload/pyload/blob/develop/src/pyload/plugins/accounts/RapideoPl.py#L38 RE ticket #ZCUY2092-HWHC-6714QLEW
- [XFS] TurbovidCo: added domain turbovidorg
- Turbovid: renamed to TurbovidMe and updated to use XFS superclass
- [XFS] VidhideCom: added new domain mycloudzcc RE forum 91406
- [XFS] StreamwishCom: added new domain 91406
- JavhdToday: updated package names RE forum 91406
vk:
- added domain vk.ru RE forum 96321
- clip crawler: allow empty title so that item is eligable for fastcrawl since not all clips have a title
- fastcrawl: temporary filenames: added fallback to 'oid_id' if given title is an empty String
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49612 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 0645f655685d0032fc6166f711390a1887302861
- RapideoPl: added more sources to find list of list of supported hosts as some were missing (thanks for not providing an API dear rapideo admins) RE ticket #ZCUY2092-HWHC-6714QLEW
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49611 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 25e141028c706c4893cf4aa15995e2b494b1fe86
- DiskYandexNet: added new plugin settings (not yet used) because the current ones are using old config and they are inconsistent (3 boolean settings vs 2 ENUM settings)
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49610 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 05a48446035ff4016e16d4391a271e9521229db9
- DiskYandexNet: fixed NPE RE ticket #KURZ8104-OKXS-8549LJSI
- rapidgatornet: added more detailed error messages for premium-only files RE forum 96317 refs #84455
- [XFS] VidhideCom: added domain playrecordbiz RE forum 96319 fixes#90501
- IPFS: fixed crawler returning wrong directURLs RE forum 94377
- OboomIo: always allow resume RE forum 96318
- JwpasteCom: minor changes
- JustPasteIt: improved offline detection RE forum 90459
- VKontakteRuHoster: added setting to allow download of original photos through 'magic trick' closes#90500
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49609 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: b6a124b0ac7045193aef8681a6138a0d72afcb7f
-updated to make use of translation
-refs #KRPH9919-RBTW-8739MTDU
-refs #23981
DegooCom:
-updated login method to support RefreshToken via access-token/v2
-fixes #KVUP0744-FYEL-1129VTCO
ImagebamCom:
-updated pattern in crawlGalleryNew
-fixes post 90141
DirectHTTP:
-updated getHost to remove www. subdomain
-refs post 90141
SimFileShareNet:
-fixes #CUAE2375-PUAX-6681LWUU
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49607 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: d7a30908524988a4b4d6fb76d3e60e284f744829
- CivitaiComCrawler: sleep 1000ms between pagination requests RE forum 96302
- Civitai: added plugin settings for pagination (not yet used) RE forum 96302
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49605 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 66dc36a609c96f0d9532ea1af562e1cf985e7953
- HentaiReadCom: improved handling which sets contentURL
- VoeSxCrawler: added new domain RE forum 90585
DiskYandexNet:
- fixed 'move quota limited files to account' handling
- 'move quota limited files to account' handling is now running in a separate thread to speed things up
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49603 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 8ca08a2325570643dcab3e049e093db5181f20cb
- HomemadeVoyeurCom: updated contenturl as directURL can only be used with specific referer RE forum 94336
- HentaiReadCom´: updated contenturl RE forum 91802
- ShrinkServiceIt: improved offline detection RE forum 90772
- BitpornoCom: fixed offline detection RE forum 92617
- RapideoPl: minor changes
- TwitterComCrawler: added better errorhandling forprofiles with zero items RE me
- ImgBoxComGallery: fixed detection of empty galleries RE forum 96316
DiskYandexNet:
- removed duplicated code
- worked on fixing auto deletion of files auto moved to account by this plugin
- moved "delete moved file and empty trash" handling into separate thread in order to allow the download of such files to start more quickly
*Plugins: New plugins*
- AdultdbIo closes#90499 RE forum 96308
*Plugins: RIP*
- HotfilEs: hotfiles.eu, hotfil.es RE forum 90424 refs #89465
- AniLinkzCom RE forum 96224
- [XFS] gounlimited.to RE forum 91701
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49602 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 9dec900359230120e3a53cd4801d8ac6bba2a8c7
-override canHandle and check for LinkCrawlerConfig.isAutoImportContainer there
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49601 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: e4ed4b0d2919f82c8b2d1e69690f5e63ab4bc4b7
- added ability to display customized error message when throwing AccountRequiredException (ability to display custom error messages for SkipReason.NO_ACCOUNT) refs #84455
- DownloadLink: added wrapper function getCustomMessage which returns content of property PROPERTY_CUSTOM_MESSAGE
- SkipReason: added 2nd getExplanation method getExplanation(Object requestor, DownloadLink link)
- other changes: refactored to use new SkipReason.getExplanation method
*Plugins: Fixes/Changes/Maintenance*
- HitomiLa: updated crawler to set contentURLs which work in browser RE forum 96305
- CivitaiCom: added explanation text for items where account is required to download them RE forum 96302
- CamwhoresTv: video which can only be downloaded with account slash private videos: display more detailed error messages to user RE ticket #DIPP7167-TBPL-3618ERUG RE forum 87310
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49597 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 70fffd78e2141359f3c70aadd3d81889c8b762a2
- cocoleechcom: removed API key format validation since that happens one level above already
- HentaiDude: renamed crawler plugin to HentaiDudeComCrawler, fixed bad filenames RE forum 88892
- HentaiReadCom: fixed RE forum 91802
- CivitaiCom: added account support via API and added detection for "only downloadable via account"- files closes#90497
DiskYandexNet:
- added field COOKIE_KEY_PASSWORD_TOKEN to be able to see more easily where that token is used/needed
- handleDownload: fixed regression: potential download failure due to linkID mismatch (this problem probably went unnoticed by users since cached direct URL handling happened before)
- improved errorhandling
- removed duplicated code
- fixed official website download in non-account mode
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49596 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: fb7eab3cbf79a2b9038cebc0ec647c1309b0a2bf
- FaceBookComGallery: improved detection of actually desired item
DiskYandexNet:
- added support for password protected folders RE ticket #LQFA3817-MCAK-6226FQNK
- added better detection- and errorhandling for "read only" files (= files where uploader has disabled official download button)
- added errorhandling for non-video 'read-only' files
- login in crawler if account is available to avoid running into anti bot blocks too often
- set last modified timestamp so that it will be set correctly even when non-original file is downloaded (e.g. stream download of non officially downloadable file)
- moved unneeded function into YandexAlbum
- refactored errorhandling
- added support to download read-only .txt files
- do not set FilePackage with name "unknown" on single file items so that Various package handling can do its job
- improved parsing of docviewer URLs
- set full relative path as package name in website- and API handling (removed inconsistency)
- match same items (internal link_id) via 'hash' as the previous set value was different depending on source (website/API)
- better error message for non downloadable read-only files
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49595 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: c2f3a89b3eb4fc5cb4c9851fa774e8e01815d7e0
- HentaiDude: minor changes
- HentaiAnimestigmaCom: renamed crawler plugin class to HentaiAnimestigmaComCrawler, fixed hosterplugin RE forum 95795
*Plugins: RIP*
- gpaste.us RE forum 96298
- [XFS] streamhub.to, streamhub.gg RE forum 92608
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49594 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: b9b3dda571d46417048b19ea51909bd560e42524
- Gogoplay4Com: added domain s3takucom RE forum 91979
- [XFS] VidhideCom: added domain dlionspro RE forum 95526
- [XFS] StreamwishCom: added domain dwishpro RE forum 94697
- MixdropCo: added domains mixdropsi and mixdropps RE forum 90254
- GooglePhotos: renamed to GooglePhotosCrawler and added detection of empty albums RE forum 96297
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49591 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: e6803d8db1bc2ad24d125ee24e6c7593e2c79681
-set setCloseReason(INTERRUPT) on InterruptedException
SkipException:
-added constructor with cause Throwable
ChallengeDialogHandler:
-updated to use new SkipException constructor with cause
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49590 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: eaac686b629b92921f7de269633d1176f3436d58
-fixed initialization race condition with HosterRuleController
YoutubeHelper:
-added applyReplacer method
-fixes post 538188
-refs post 538187
LinkCrawlerRetry:
-updated getHost to make use of LinkCrawler.cleanURL
EvilangelCore:
-updated pattern to allow % for urlencoded chars
-updated getURLTitle to urldecode
-fixes #WVPG4454-FGLJ-5570NVOY
GenericHTTPDirectoryIndexCrawler:
-added support for AuthenticationController.buildAuthenticationFactories
-fixes #ZULZ9282-UNED-7292NJXY
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49586 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: bff38a5802bd18a600d7ce3903b030e6ba8abd4d
- YourfilestoreCom RE forum 95753 closes#90458
- Fsiblog2ComCrawler: set added URL as contentURL since directURL cannot be accessed without special referer RE forum 94290
- opensubtitlesorg: minor changes
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49584 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 9c44902fa08661cdbddb5dc8118eca280d34a409
- deviantart: minor changes to early return principle, added try catch block to catch AccountRequiredException
- GamestarDeCrawler: find embedded dailymotion items RE forum 91972
- Fsiblog2ComCrawler: added new domain fsiblog3club, fixed non working download due to newly added simple referer protection RE forum 94290
- OpenSubtitlesOrg: added captcha support RE forum 96283 fixes#90495
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49583 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 7fa39799b702830c45915221bae55c3fe9be372e
- vk: some work on API pagination in website mode refs #90427
- VoeSxCrawler: added domain josephseveralconcerncom, updated runPostRequestTask handling to also work for unsupported domains RE forum 91740
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49579 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 633cfb623358a8765254b8ed16ea3f5582844b29
- ShrtflyVip: added domain stlylink, added detection for unsupported captcha Cloudflare Turnstile RE forum 91682 refs #90281
- ImcontentMe: fixed RE forum 94276
- FbjavNet: fixed RE forum 94276
- CompuPasteCom: added boxsphinxanimenet RE forum 94277
- GenericYetiShareFolder: added megaupnet RE forum 94277
- FcLc: fixed RE forum 94277
- VKontakteRuHoster: added errorhandling for '451 unavailable for legal reasons' RE forum 30431
- EvilangelTouchmywifeCom: updated comment RE ticket #WVPG4454-FGLJ-5570NVOY
- DeviantArtCom: updated errorhandling for mature/paid content slash blurred images and added errorhandling to avoid downloading blurred images RE forum 96275 refs #90403
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49578 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 54ab2caeef4e45dd66e647d928adc57947622811
- imgsrc: added errorhandling for http 400, they are using this to indicate that a rate limit has been reached RE forum 96279
- DwCom: updated pattern RE forum 91928
- CivitaiComCrawler: fixed pagination, allow fof 'non full pages in between' RE forum 95297
- etsy: allow redirects RE forum 94068
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49577 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: d36ba000ff38768bddb5a93f4480a070e7c792aa
-updated addContextSetup to allow specific index
-now uses List instead of Set to allow element order
InfoPanel:
-sort each ActionContext on its own -> grouping by ActionContext
git-svn-id: svn://svn.jdownloader.org/jdownloader/trunk@49572 ebf7c1c2-ba36-0410-9fe8-c592906822b4
Former-commit-id: 14bb8997390ec0c7269da39f31755b7ebdbfc7e5
