mirror of
https://github.com/BillyOutlast/metadata-scrapers.git
synced 2026-02-04 03:01:16 +01:00
4a1db966264172e1272c252fb6d896c36cca37bc
FansDB community metadata scrapers
These community scrapers are tailored towards FansDB data structure. To use you need to have stashapp/stash application.
Install
- To add a new source go to Settings > Metadata Providers page.
- Under Available Scrapers click Add Source.
- Add the following details:
- Name:
FansDB - Source URL:
https://fansdb.github.io/scrapers/main/index.yml - Local path:
fansdb
- Name:
- Click Confirm.
- Under Available Scrapers select FansDB package to expand it and see all available scrapers.
- Click the checkmark next to relevant scraper and click Insall.
Contributing
Pull requests are welcome.
Repository structure
- Each scraper should have its own folder under ./scrapers.
- Folder name should reflect the network name used in FansDB.
Validation
The scrapers in this repository can be validated against a schema and checked for common errors.
First, install the validator's dependencies - inside the ./validator folder, run: yarn.
Then, to run the validator, use node validate.js in the root of the repository.
Specific scrapers can be checked using: node validate.js scrapers/folder/example.yml scrapers/folder2/example2.yml
Attributions
From https://github.com/stashapp/CommunityScrapers under AGPL-3.0:
./validate.js./build-site.sh./validator/*./.github/workflows/validate.yml
Languages
Python
70.9%
JavaScript
23.8%
Shell
5.3%