Hello, welcome to the MultiCrawler robots page.
We are running MultiCrawler as part of SWSE, the Semantic Web Search Engine.
MultiCrawler honors the Robots Exclusion Protocol. If not, please let us know where and when (mailto:andreas.harth@deri.org).
Thanks!