Wait! Exclusive 60 day trial to the world's largest digital library.
The SlideShare family just got bigger. You now have unlimited* access to books, audiobooks, magazines, and more from Scribd.Cancel anytime.
[BrightonSEO April 2019] This talk shares the detailed methodology used to restructure a job aggregator site, which, like many large websites, had huge problems with indexability, and the rules used to direct robot crawl, taking the site from over 2.5 million URLs to just 20,000. It covers crawling and indexing issues and dive into the case study aided by flow charts to explain the full approach used to restructure the site and how to implement it.