To prevent undesirable articles within the search indexes, webmasters can instruct spiders to not crawl particular files or directories through the regular robots.txt file in the foundation Listing from the area. Furthermore, a web site is often explicitly excluded from the search engine's database through the use of a meta https://news.rafeeg.ae