v2の新着情報
サイトマップ制御の強化
"include"
- サイトマップを使用し、他のページも検出(デフォルト)"skip"
- サイトマップを完全に無視"only"
- サイトマップのURLのみを返す
レスポンス形式の変更
links
のオブジェクト配列で、より充実したメタデータ付きのリンクを返すようになりました。
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Body
The base URL to start crawling from
Specify a search query to order the results by relevance. Example: 'blog' will return URLs that contain the word 'blog' in the URL ordered by relevance.
Sitemap mode when mapping. If you set it to skip
, the sitemap won't be used to find URLs. If you set it to only
, only URLs that are in the sitemap will be returned. By default (include
), the sitemap and other methods will be used together to find URLs.
skip
, include
, only
Include subdomains of the website
Do not return URLs with query parameters
Maximum number of links to return
x <= 30000
Timeout in milliseconds. There is no timeout by default.
Location settings for the request. When specified, this will use an appropriate proxy if available and emulate the corresponding language and timezone settings. Defaults to 'US' if not specified.