@konstantin Here's a blog from someone who's stood up a public Apache Solr instance with a custom frontend: https://blog.searchmysite.netHe uses Scrapy to crawl registered sites.