Replacing Google Site Search with AWS Cloudsearch

Question

So I'm working on a site that has pretty specific global site search functionality that utilizes GSS which, as many of you already know, is going away in April. I need to crawl the site and send XML over to Cloudsearch, but I'm kind of confused as to how to go about this and I haven't found much material on building a global site search using AWS Cloudsearch after scouring the internet for a couple of days. So far, I'm planning on crawling the site with Apache Nutch, but I would really appreciate some input.

Answer 1

Did you come across our blog? Index the web with AWS CloudSearch Index the web with StormCrawler (revisited) . I described how to use Nutch and StormCrawler to index to AWS Cloudsearch.

If you need the search to be hosted, I'd recommend Elasticsearch and Elastic Cloud instead. I found Cloudsearch slow, cumbersome and expensive and also there are more resources for Elasticsearch for StormCrawler and Apache Nutch.