抓取API接口文档/创建任务

创建网页抓取任务

post

头参数

Authorizationstring必填

认证token，格式Bearer {token}，token前往官网个人中心获取

Example: Bearer ****************

Content-Typestring必填Example: application/x-www-form-urlencoded

请求体

application/x-www-form-urlencoded

spider_namestring必填

工具名称

Example: reddit.com

spider_idstring必填

工具ID

Example: reddit_posts_by-url

spider_parametersstring必填

抓取内容传参

Example: [ { "url": "https://www.reddit.com/r/battlefield2042/comments/1cmqs1d/official_update_on_the_next_battlefield_game/" }, { "url": "https://www.reddit.com/r/FlappyGoose/comments/1nn4f1o/upvote_if_you_beat_it/?entry_point=games_drawer_personalized_game" }, { "url": "https://reddit.com/r/datascience/comments/1cmnf0m/technical_interview_python_sql_problem_but_not/" } ]

spider_errorsstring必填Example: true

file_namestring必填

以任务ID命名

Example: {TasksID}

响应

200

成功

application/json

404

失败

application/json

post

/builder

HTTPcURLJavaScriptPython

POST /builder HTTP/1.1
Host: 
Authorization: text
Content-Type: application/x-www-form-urlencoded
Accept: */*
Content-Length: 565

"spider_name='reddit.com'&spider_id='reddit_posts_by-url'&spider_parameters=' [\n    {\n      \'url\': \'https://www.reddit.com/r/battlefield2042/comments/1cmqs1d/official_update_on_the_next_battlefield_game/\'\n    },\n    {\n      \'url\': \'https://www.reddit.com/r/FlappyGoose/comments/1nn4f1o/upvote_if_you_beat_it/?entry_point=games_drawer_personalized_game\'\n    },\n    {\n      \'url\': \'https://reddit.com/r/datascience/comments/1cmnf0m/technical_interview_python_sql_problem_but_not/\'\n    }\n  ]'&spider_errors='true'&file_name='{TasksID}'"

{
  "code": 200,
  "data": {
    "task_id": "17d261ce8a8347d6a8f9e867ac92e0d2"
  }
}

创建视频下载任务

post

头参数

Authorizationstring必填

认证token，格式Bearer {token}，token前往官网个人中心获取

Example: Bearer ****************

Content-Typestring必填Example: application/x-www-form-urlencoded

请求体

application/x-www-form-urlencoded

spider_namestring必填

工具名称

Example: youtube.com

spider_idstring必填

工具ID

Example: youtube_video_by-url

spider_parametersstring必填

抓取内容传参

Example: [ { "url": "https://www.youtube.com/watch?v=8RePenzQH80" } ]

spider_universalstring必填

视频参数

Example: { "resolution": ">=360p", "bitrate": ">=128", "video_codec": "vp9", "audio_format": "opus", "is_subtitles": "false", "selected_only": "false" }

spider_errorsstring必填Example: true

file_namestring必填

以任务ID命名

Example: {TasksID}

响应

200

成功

application/json

404

失败

application/json

post

/video_builder

HTTPcURLJavaScriptPython

POST /video_builder HTTP/1.1
Host: 
Authorization: text
Content-Type: application/x-www-form-urlencoded
Accept: */*
Content-Length: 687

"spider_name='youtube.com'&spider_id='youtube_video_by-url'&spider_parameters='[\n            {\n            \'url\': \'https://www.youtube.com/watch?v=8RePenzQH80\'\n            }\n    ]'&spider_universal=' {\n                                    \'resolution\': \'>=360p\',\n                                    \'bitrate\': \'>=128\',\n                                    \'video_codec\': \'vp9\',\n                                    \'audio_format\': \'opus\',\n                                    \'is_subtitles\': \'false\',\n                                    \'selected_only\': \'false\'\n                                }'&spider_errors='true'&file_name='{TasksID}'"

{
  "code": 200,
  "data": {
    "task_id": "e03ded0d8ab94b5faba691cb4c8b0b5b"
  }
}