bandcamp-fetch/README.md

221 lines
6.2 KiB
Markdown
Raw Normal View History

2021-01-19 21:37:31 +01:00
# bandcamp-fetch
A JS library for scraping Bandcamp content; inspired by [bandcamp-scraper](https://github.com/masterT/bandcamp-scraper).
# Installation
```
npm i bandcamp-fetch --save
```
# Usage
```
const bcfetch = require('bandcamp-fetch');
bcfetch.discover(...).then( results => {
...
});
```
# API
Each function returns a Promise which resolves to the fetched data.
2021-01-26 10:24:10 +01:00
### `discover([params], [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/discover.js) ([output](examples/discover_output.txt))
Fetches albums through Bandcamp Discover.
- `params` (optional) - object specifying params to be passed to Bandcamp Discover
- genre
- subgenre: only valid when genre is something other than 'all'
- location
- sortBy
- artistRecommendationType: only valid when sortBy is 'rec' (artist recommended)
- format
- time
- page
All properties are optional. Possible values for each property can be obtained with the `getDiscoverOptions()` function.
2021-01-26 10:24:10 +01:00
`params` passed to this function will be sanitized with `sanitizeDiscoverParams()`. A copy of the sanitized params can obtained through the `params` property of the returned result.
2021-01-19 21:37:31 +01:00
- `options` (optional) - object specifying options to be used when formulating results:
- albumImageFormat: name, Id or object referring to an image format.
- artistImageFormat
All properties are optional. Image formats can be obtained with the `getImageFormats()` function.
2021-01-26 10:24:10 +01:00
### `getDiscoverOptions()`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getDiscoverOptions.js) ([output](examples/getDiscoverOptions_output.txt))
Fetches Bandcamp Discover options that can be passed back to `discover()`.
2021-01-26 10:24:10 +01:00
### `sanitizeDiscoverParams(params)`
[**Example**](examples/sanitizeDiscoverParams.js) ([output](examples/sanitizeDiscoverParams_output.txt))
Sanitizes `params` by setting default values for omitted params and removing irrelevant ones.
You don't have to call this function on params passed to `discover()` - they will be sanitized automatically.
### `getImageFormats([filter])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getImageFormats.js) ([output](examples/getImageFormats_output.txt))
Fetches the list of image formats used in Bandcamp.
- `filter` (optional) - 'artist' or 'album'. If specified, narrows down the result to include only formats applicable to the specified value.
2021-01-26 10:24:10 +01:00
### `getImageFormat(idOrName)`
2021-01-19 21:37:31 +01:00
Fetches the image format that matches Id or name. If none is found, the result will be `null`.
2021-01-26 10:24:10 +01:00
### `getArtistOrLabelInfo(artistOrLabelUrl, [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getArtistOrLabelInfo.js) ([output](examples/getArtistOrLabelInfo_output.txt))
Fetches information about an artist or label.
- `artistOrLabelUrl`
- `options` (optional)
- imageFormat
2021-01-26 10:24:10 +01:00
### `getLabelArtists(labelUrl, [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getLabelArtists.js) ([output](examples/getLabelArtists_output.txt))
Fetches the list of artists belonging to a label.
- `labelUrl`
- `options` (optional)
- imageFormat
2021-01-26 10:24:10 +01:00
### `getDiscography(artistOrLabelUrl, [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getDiscography.js) ([output](examples/getDiscography_output.txt))
Fetches the list of albums and standalone tracks belonging to an artist or label.
- `artistOrLabelUrl`
- `options` (optional)
- imageFormat
2021-01-26 10:24:10 +01:00
### `getAlbumInfo(albumUrl, [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getAlbumInfo.js) ([output](examples/getAlbumInfo_output.txt))
Fetches information about an album.
- `albumUrl`
- `options` (optional)
- albumImageFormat
- artistImageFormat
- includeRawData
2021-01-26 10:24:10 +01:00
### `getTrackInfo(trackUrl, [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getTrackInfo.js) ([output](examples/getTrackInfo_output.txt))
Fetches information about a track.
- `trackUrl`
- `options` (optional)
- albumImageFormat
- artistImageFormat
- includeRawData
2021-01-26 10:24:10 +01:00
### `getAlbumHighlightsByTag(tagUrl, [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getAlbumHighlightsByTag.js) ([output](examples/getAlbumHighlightsByTag_output.txt))
Fetches album highlights for the tag referred to by `tagUrl`. The result is an array of album collections, with each collection corresponding to a highlight category such as 'new and notable' and 'all-time best selling'.
- `tagUrl`
Tag URLs can be obtained with the `getTags()` function.
- `options` (optional)
- imageFormat
2021-01-26 10:24:10 +01:00
### `getTags()`
2021-01-19 21:37:31 +01:00
[**Example**](examples/getTags.js) ([output](examples/getTags_output.txt))
Fetches Bandcamp tags. The result is an object with the following properties:
- `tags`: non-location tags
- `locations`: location tags
2021-01-26 10:24:10 +01:00
### `search(params, [options])`
2021-01-19 21:37:31 +01:00
[**Example**](examples/search.js) ([output](examples/search_output.txt))
Searches for `params.query`.
- `params`
- query: search string
- page (1 if omitted)
- `options` (optional)
- albumImageFormat
- artistImageFormat
2021-02-03 11:09:12 +01:00
### `getAllShows([options])`
[**Example**](examples/getAllShows.js) ([output](examples/getAllShows_output.txt))
Fetches all Bandcamp shows. Each entry in the returned array contains basic information about a show. To retrieve details of a show, pass the `url` property of the entry to `getShow()`.
- `options` (optional)
- showImageFormat
### `getShow(showUrl, [options])`
[**Example**](examples/getShow.js) ([output](examples/getShow_output.txt))
Get show details for the given `showUrl`.
- `options` (optional)
- albumImageFormat
- artistImageFormat
- showImageFormat
2021-01-26 10:24:10 +01:00
## Caching
The library maintains an in-memory cache for two types of resources:
1. `page` - pages fetched during scraping
2. `constant` - image formats and discover options
Functions related to the cache can be called this way:
```
const bcfetch = require('bandcamp-fetch');
bcfetch.cache.setTTL('page', 500);
bcfetch.cache.setMaxPages(20);
bcfetch.cache.clear('constant');
```
### `cache.setTTL(type, TTL)`
Sets the expiry time, in seconds, of cache entries for the given resource type.
- `type`: 'page' or 'constant'
- `TTL`: expiry time in seconds (default: `300` for 'page' and `3600` for 'constant')
### `cache.setMaxPages(maxPages)`
Sets the maximum number of pages that can be stored in the cache. A negative value means unlimited. Default: `10`.
### `cache.clear([type])`
Clears the cache entries for the given resource type.
- `type` (optional): 'page' or 'constant'. If unspecified, clears the entire cache.
2021-01-19 21:37:31 +01:00
# License
MIT