Current location - Recipe Complete Network - Complete cookbook - Can you write a reptile in Python and be a search engine in the unpopular industry?
Can you write a reptile in Python and be a search engine in the unpopular industry?
The simple way is to write a Baidu crawler, build your own website and jump directly to the results of Baidu search ~

A slightly more complicated approach is to add a screening function on the basis of the above, and eliminate all the content that is not in the industry!

In the more complex, collect some professional information, such as the web pages of several forums or related information publishing institutions, and then make corresponding crawlers, write a database and write a website.

Because the industry is unpopular, there are also problems of small audience and less content (relatively speaking). You can build your own website, but it still takes a lot of effort to expand your influence. At least, people in this industry have to recognize you!

Of course, if it's just for personal use, it's easy. Even a command-line version of the query system is possible, which is nothing more than data integration, real-time capture and so on!

I remember that I wanted to write a crawler before, which integrated several pirated novel websites. After searching, I chose different websites to download novels ~ I wrote half of them, and then I found the software that can be realized. . . Very collapsed. . .

Later, I found it very convenient to write a Baidu crawler and then specify keywords to display the search results, which is also suitable for lazy people like me. . .

I hope I can help you!