A collection of video URLs in a web page
Create a page turning cycle
Enter the collection rule setting interface, enter the URL of the video website in the address bar, as shown in the figure, and click the button on the right.
Open this webpage in octopus collector's built-in browser.
Find the page turning button in the favorite video station, move the mouse to select it, right click,
Execute the "click next page repeatedly" option in the red box.
After the above operations are completed, the left process designer displays the page turning cycle box, and the page turning cycle is created, as shown in the figure.
Create a circular click list
Move the mouse to select the title in the video list, click the right mouse button and select "Create Element List" in the red box.
Select Add to List
The element will be added to the list above and "Continue Editing List" will be executed.
Select the second video in the video list and add it to the element list in the same way.
Other video titles in the video list will be crawled into the element list, because we are adding elements with two similar characteristics.
Octopus collector will intelligently add other elements with similar characteristics to the page. Click "Create list complete"
Click "Cycle" as shown in the figure.
The process designer in the upper left corner will display a loop box for clicking the element. Complete the creation of circular click list.
Crawl video URL
Move the mouse to the video title, right-click and select "Grab the text of this element" in the red box to grab the video title.
The captured title will be displayed in the action box in the upper right corner. Click "Add other special fields" and select "Add URL of current page".
Extract the URL of this video, and then click the Save button in the lower right corner.
Complete the video URL extraction step.
Since each page needs to collect data circularly, we need to drag this circular list into the page turning cycle.
Note: the process is executed from the last page, so this circular list needs to be placed in front of the clicked page, otherwise the data on the first page will be missed.
The completed collection rules are displayed in the red box in the figure. Click Save at the bottom right, and then click Next to start collecting video URLs.
Start collecting
Select single capture to start extracting video URL.
After collection, export the URL of the video.
After exporting the video URL, use the video URL batch download tool to download the video.