5. @audisto #TechSEOBoost
Google-Patent: Scheduler for Search Engine Crawler
Retrieve Next Base Layer Segment of URLs
Compute Score(s) for all URLs in Segment
Sort URLs by Score(s)
Select URLs Having Keep Score Above Keep Threshold
Set Crawl/Reuse and Daily Flags for Selected URLs Having
Crawl and Daily Scores Above Crawl and Daily Thresholds
Write Selected URL, Page Rank, Crawl/Reuse Flag,
and Daily Flag to Schedule Output File
13. @audisto #TechSEOBoost
Collect Data to Compare
Type of Pagination Max Depth
Item Page
% PageRank
Pagination Pages
% PageRank
Item Pages
# SEO-Relevant
Pagination Pages
# SEO-Relevant
Item Pages
Basic Pagination 100 51 49 4 60
First Pages
First and Last Page
First, Last and Neighbors
Neighbors
Fixed Steps
Fixed Block
Logarithmic Pagination
Ghostblock
PageRank >= PageRank
of weakest page in best
pagination