Ask Google to recrawl your URLs

Ask Google to recrawl your URLs

If you’ve recently added or made changes to a page on your site, you can ask Google to (re)index it using any of the methods listed here.

General guidelines

  • Requesting a recrawl multiple times or using multiple methods for the same URL won’t get it crawled any faster.
  • Crawling can take anywhere from a few days to a few weeks. Be patient, and monitor progress using either the Index Status report or the URL Inspection tool.
  • There is a quota for submitting individual URLs using any of these methods.
  • All methods have about the same response time.

Specific methods::

* Use Fetch as Google

The Fetch as Google tool has a “Request indexing” feature to submit individual URLs to the index. If you have a large number of URLs to submit, it is easier to submit a sitemap instead.

Requirements:

You can request indexing using Fetch as Google only for a fetch that meets these criteria:

  • The fetch must have a completepartial, or redirected fetch status.
  • The fetch cannot be more than 4 hours old.
Google crawls and indexes the URL content as served when Googlebot accepts the request, not from a snapshot of the Fetch as Google results.

To submit a URL to the index:

  1. Perform a fetch (or fetch and render) request for a URL using Fetch as Google, or choose a recent successful fetch request in the table that satisfies the requirements listed previously. Make sure that the page appears in the fetch as you think it should; if the page cannot be reached by the fetch tool or doesn’t display fully to the fetch tool, it might be misclassified or not crawlable by Google.
  2. Click Request indexing next to the fetch in the fetch history table. If Request indexing does not appear next to a fetch, the fetch didn’t fulfill the requirements listed above.
  3. Select whether to crawl only that single URL, or that URL plus its direct links:
    •  Crawl only this URL submits only the selected URL to the Google for re-crawling. You can submit up to 10 individual URLs per day.
    • Select Crawl this URL and its direct links to submit the URL as well as all the other pages that URL links to directly for re-crawling. You can submit up to 2 of these site recrawl requests per day.
  4. Click Submit to queue your request.
  5. Recrawling is not immediate or guaranteed. It typically takes several days for a successful request to be granted. Also, understand that we can’t guarantee that Google will index all your changes, as Google relies on a complex algorithm to update indexed materials.

* Submit a sitemap

A sitemap is a good way to submit several URLs at once, and can also include additional metadata about  alternate language versions and video-, image-, or news-specific pages. Learn more about sitemaps.

There are a few ways to submit a sitemap:

  • Submit a sitemap using the Sitemaps report. (Full instructions)
  • Use the ping tool. Send a GET request in your browser or the command line to this address, specifying the full URL of the sitemap. Be sure that the sitemap file is accessible:
      http://www.google.com/ping?sitemap=<full_URL_of_sitemap>
    Example:
      http://www.google.com/ping?sitemap=https://example.com/sitemap.xml
  • Insert the following line anywhere in your robots.txt file, specifying the path to your sitemap. We will find it the next time we crawl your site:
    Sitemap: http://example.com/my_sitemap.xml

source:
https://support.google.com/webmasters/answer/6065812?hl=en

 

 

Please follow and like us:
0

Leave a Reply

Your email address will not be published. Required fields are marked *