webcrawling
Latest
Google will continue to let sites opt out of showing in search results
Google swears it won't start scraping websites that previously opted out of web crawling just because it can now legally go back to its old ways. Back in 2012, the tech titan promised to change its practices in several areas to settle an antitrust investigation by the FTC. Those changes include removing AdWords restrictions that made it difficult for advertisers to launch multi-platform campaigns, as well as providing websites a mechanism to opt out of having their content crawled and displayed on search results. Both commitments expired on December 27th, 2017, but in a letter to the FTC, the company says it intends to continue honoring them.
