TrawlerEvent

AI Overview😉

  • The potential purpose of this module is to log and track events that occur during a URL fetch, such as when a fetch starts, when a URL is rejected, and other notable events. This helps Google to monitor and analyze the crawling process.
  • This module could impact search results by influencing the crawling and indexing process. For instance, if a URL is frequently rejected, it may affect its chances of being indexed or ranked higher in search results. Conversely, if a URL is quickly fetched and processed, it may improve its visibility in search results.
  • A website may change things to be more favorable for this function by ensuring that their URLs are easily crawlable, responding quickly to crawl requests, and minimizing errors or rejections during the crawling process. This could involve optimizing server response times, reducing broken links or redirects, and improving website architecture to facilitate efficient crawling.

Interesting Module? Vote 👇

Voting helps other researchers find interesting modules.

Current Votes: 1

GoogleApi.ContentWarehouse.V1.Model.TrawlerEvent (google_api_content_warehouse v0.4.0)

Event is for logging interesting events that happen during a url fetch. Interesting events include "fetch start", "url rejected", etc. The events are written to binary logs together with the request and reply messages. If the same event occurs multiple times consecutively, We record the time of the first three instances in EarliestTimeStamp but omit the rest. We keep track the total number of occurrences in NumOccurrences and the timestamp of the last occurrence is kept in TimeStamp field.

Attributes

  • ID (type: String.t, default: nil) -
  • Msg (type: String.t, default: nil) -
  • NumOccurrences (type: integer(), default: nil) -
  • OldestTimeStampInUS (type: list(String.t), default: nil) - Limited to 3.
  • TimeStampInUS (type: String.t, default: nil) -

Summary

Types

t()

Functions

decode(value, options)

Unwrap a decoded JSON object into its complex fields.

Types

Link to this type

t()

@type t() :: %GoogleApi.ContentWarehouse.V1.Model.TrawlerEvent{
  ID: String.t() | nil,
  Msg: String.t() | nil,
  NumOccurrences: integer() | nil,
  OldestTimeStampInUS: [String.t()] | nil,
  TimeStampInUS: String.t() | nil
}

Functions

Link to this function

decode(value, options)

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.