{"id":279,"date":"2017-08-09T19:02:57","date_gmt":"2017-08-09T19:02:57","guid":{"rendered":"https:\/\/swatilathia.wordpress.com\/?p=279"},"modified":"2022-03-09T07:05:22","modified_gmt":"2022-03-09T07:05:22","slug":"session-ids-in-urls-crawler-confusion","status":"publish","type":"post","link":"https:\/\/swatilathia.com\/?p=279","title":{"rendered":"Session Ids in URLs : Crawler Confusion"},"content":{"rendered":"

Session IDs are most common in e-commerce sites and are embedded in a URL so the website can track their users or consumers from page to page and they are used to keep track of items in a consumer\u2019s shopping cart.<\/p>\n

But these IDs cause problems for search engine crawlers because they create a large number of links for the spider to crawl. This can create a situation where the search engine indexes essentially the same page over and over. Search engines like Google refer to it as a \u2018spider trap\u2019, which we will discuss later on.<\/p>\n

Below are a few examples of how session IDs can give the appearance of an endless number of pages within a single site. A crawler coming to your website may find a page with the following URL:<\/p>\n

http:\/\/www.yoursite\/shop.cgi?id=dkom2354kle03i<\/a><\/p>\n

This page gets indexed but when the spider returns later to look for new content, it finds the following:<\/p>\n

http:\/\/www.yoursite\/shop.cgi?id=hj545jkf93jf4k<\/a><\/p>\n

This is actually the same page as before, just with a different special session ID but the spider sees it as a new URL. Because of this confusion, search engine spiders are programmed to avoid pages containing these session IDs.<\/p>\n<\/body>","protected":false},"excerpt":{"rendered":"

Session IDs are most common in e-commerce sites and are embedded in a URL so the website can track their users or consumers from page to page and they are used to keep track of items in a consumer\u2019s shopping cart. But these IDs cause problems for search engine crawlers because they create a large […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"zakra_page_container_layout":"customizer","zakra_page_sidebar_layout":"customizer","zakra_remove_content_margin":false,"zakra_sidebar":"customizer","zakra_transparent_header":"customizer","zakra_logo":0,"zakra_main_header_style":"default","zakra_menu_item_color":"","zakra_menu_item_hover_color":"","zakra_menu_item_active_color":"","zakra_menu_active_style":"","zakra_page_header":true,"om_disable_all_campaigns":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[17,41],"tags":[],"class_list":["post-279","post","type-post","status-publish","format-standard","hentry","category-seo","category-seo-tutorial"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/posts\/279","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/swatilathia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=279"}],"version-history":[{"count":1,"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/posts\/279\/revisions"}],"predecessor-version":[{"id":2023,"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/posts\/279\/revisions\/2023"}],"wp:attachment":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=279"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/swatilathia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=279"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/swatilathia.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=279"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}