TrawlerCrawlTimes

AI Overview😉

  • The potential purpose of this module is to track and store information about when a webpage was crawled, when it was last changed, and when it was reused (i.e., found to be the same as before) by Google's crawler. This allows Google to keep track of webpage updates and optimize its crawling and indexing processes.
  • This module could impact search results by influencing how often a webpage is crawled and indexed, which in turn affects its visibility and ranking in search results. For example, if a webpage is frequently updated, Google may crawl it more often, which could lead to more up-to-date search results. On the other hand, if a webpage remains unchanged for a long time, Google may reduce its crawling frequency, which could negatively impact its search engine ranking.
  • To be more favorable for this function, a website could ensure that it has a clear and consistent update schedule, making it easier for Google's crawler to determine when the webpage has changed. Additionally, the website could implement efficient caching and content delivery mechanisms to reduce the load on Google's crawler and make it easier to determine when the webpage has been reused. Furthermore, the website could provide clear and accurate metadata, such as last-modified dates, to help Google's crawler understand when the webpage has changed.

Interesting Module? Vote 👇

Voting helps other researchers find interesting modules.

Current Votes: 3

GoogleApi.ContentWarehouse.V1.Model.TrawlerCrawlTimes (google_api_content_warehouse v0.4.0)

This is similar to CrawlDates group in FetchReplyData, except that 1) it's a message; 2) it's filled in each Redirects hop; and 3) the timestamps are in ms rather than seconds since Unix Epoch.

Attributes

  • NotChangedTimeMs (type: String.t, default: nil) - fetched from the web. Time when the page was last
  • OriginalCrawlTimeMs (type: String.t, default: nil) - Time when the page was
  • ReuseTimeMs (type: String.t, default: nil) - checked but found to be the same as before. If set, timestamp to indicate

Summary

Types

t()

Functions

decode(value, options)

Unwrap a decoded JSON object into its complex fields.

Types

Link to this type

t()

@type t() :: %GoogleApi.ContentWarehouse.V1.Model.TrawlerCrawlTimes{
  NotChangedTimeMs: String.t() | nil,
  OriginalCrawlTimeMs: String.t() | nil,
  ReuseTimeMs: String.t() | nil
}

Functions

Link to this function

decode(value, options)

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.