Implementing a docs search for multiple docs sites

Solution 1:

Algolia is the absolute best solution that I can think of. There's also Typesense and Meilisearch of course.

Algolia is meant specifically for situations like yours, so it even comes with a crawler. https://www.algolia.com/products/search-and-discovery/crawler/

https://www.algolia.com/

https://typesense.org/

https://www.meilisearch.com/

Here's a fun page comparing them (probably a little biased in Typesense's favor) https://typesense.org/typesense-vs-algolia-vs-elasticsearch-vs-meilisearch/

Here are some example sites that use Algolia Search

https://developers.cloudflare.com/

https://getbootstrap.com/docs/5.1/getting-started/introduction/

https://reactjs.org/

https://hn.algolia.com/

If you personally are just trying to search for a keyword, as long as they're indexed by Google, you can always search with the format site:{domain} "keyword"

Solution 2:

You can checkout Meilisearch for your use case. Meilisearch is a Rust based and open sourced search engine.

Meilisearch comes with a document scraper tool ( https://github.com/meilisearch/docs-scraper ) that can scrape content and then also index it.

While using it you need to define what exact content you are searching for in the configuration file for the scraper tool. And then you can run the tool using Docker.