bulk email server

Results 1 to 7 of 7

Share Thread: Website Indexing Issues

  1. #1
    Member
    Join Date
    Nov 2017
    Location
    Delhi, India
    Posts
    36
    Feedback Score
    0

    Website Indexing Issues

    VPS Hosting
    Hello,


    What do you guys do when a website doesn't gets indexed regularly?

  2. #2
    Senior Member
    Join Date
    Sep 2017
    Posts
    478
    Feedback Score
    0
    Identifying Crawling problems
    Fixing Crawling Errors in robots.txt, htaccess, meta tags, sitemaps, URL parameters, etc.

  3. #3
    Senior Member
    Join Date
    Aug 2017
    Location
    Bangalore
    Posts
    217
    Feedback Score
    0
    Connectivity or DNS issues
    Inherited issues
    Identifying Crawling Problems
    Fixing Crawling Errors
    Robots.txt
    .htaccess
    Meta tags
    Sitemaps

  4. #4
    Senior Member
    Join Date
    Aug 2017
    Location
    Bangalore
    Posts
    217
    Feedback Score
    0
    Connectivity or DNS issues
    Inherited issues
    Identifying Crawling Problems
    Fixing Crawling Errors
    Robots.txt
    .htaccess
    Meta tags
    Sitemaps

  5. #5
    Senior Member
    Join Date
    Nov 2017
    Location
    Mumbai, India
    Posts
    100
    Feedback Score
    0
    Regularly, you mean daily?? it is not possible until you have a very good and popular sites with lots of content like any big news papers and all..

    Update your sitemap regularly, Further you may try for Fetch as Google Bot option under Google Webmaster Tool

    Thanks
    EWEBAC - SEO Company in Mumbai. Offers result oriented SEO Services for SME's. Also visit for more seo tips & tricks.

  6. #6
    Senior Member
    Join Date
    Apr 2018
    Posts
    188
    Feedback Score
    0
    Identifying Crawling Problems

    Fixing Crawling Errors

    Robots.txt - This text file which sits in the root of your website's folder communicates a certain number of guidelines to search engine crawlers. For instance, if your robots.txt file has this line in it; User-agent: * Disallow: / it's basically telling every crawler on the web to take a hike and not index ANY of your site's content.

    .htaccess - This is an invisible file which also resides in your WWW or public_html folder. You can toggle visibility in most modern text editors and FTP clients. A badly configured htaccess can do nasty stuff like infinite loops, which will never let your site load.

    Meta tags - Make sure that the page(s) that's not getting indexed doesn't have these meta tags in the source code: <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

    Sitemaps - Your sitemap isn't updating for some reason, and you keep feeding the old/broken one in Webmaster Tools. Always check, after you have addressed the issues that were pointed out to you in the webmaster tools dashboard, that you've run a fresh sitemap and re-submit that.

    URL parameters - Within the Webmaster Tools there's a section where you can set URL parameters which tells Google what dynamic links you do not want to get indexed. However, this comes with a warning from Google: "Incorrectly configuring parameters can result in pages from your site being dropped from our index, so we don't recommend you use this tool unless necessary."

    You don't have enough Pagerank - Matt Cutts revealed in an interview with Eric Enge that the number of pages Google crawls is roughly proportional to your Pagerank.

    Connectivity or DNS issues - It might happen that for whatever reason Google's spiders cannot reach your server when they try and crawl. Perhaps your host is doing maintenance on their network, or you've just moved your site to a new home, in which case the DNS delegation can stuff up the crawlers access.

    Inherited issues - You might have registered a domain which had a life before you. I've had a client who got a new domain (or so they thought) and did everything by the book. Wrote good content, nailed the on-page stuff, had a few nice incoming links, but Google refused to index them, even though it accepted their sitemap. After some investigating, it turned out that the domain was used several years before that, and part of a big linkspam farm. We had to file a reconsideration request with Google.4

  7. #7
    Senior Member
    Join Date
    Apr 2018
    Posts
    116
    Feedback Score
    0
    @sankalppatil well this is great explanation about Indexing Issues.
    Click here to visit on Guest Post Service Guest Posting Service & Premium Guest Posting Service

 

 

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •