If you want to know why Newscorp isn’t happy with Google crawling it’s content then here’s a quick graphic to explain. Search engines unlike most other business models have a right to use your content by the permission you give them to allow their robots to crawl your web content. To date News has allowed this but switching off this right will remove Newscorp content from Google.