CompositeDocRobotsInfoList

AI Overview😉

  • The potential purpose of this module is to analyze and store information about robots.txt directives for user-agents other than the default crawler used by Google. This allows Google to understand how different crawlers or user-agents are instructed to crawl and index a webpage.
  • This module could impact search results by influencing how Google indexes and crawls webpages. If a webpage has specific robots.txt directives for certain user-agents, Google may adjust its crawling and indexing behavior accordingly. This could lead to differences in search result rankings or the inclusion/exclusion of certain webpages in search results.
  • To be more favorable for this function, a website could ensure that its robots.txt file is up-to-date, accurate, and specifies clear directives for different user-agents. This would help Google understand the website's crawling and indexing preferences, potentially leading to more accurate and relevant search results. Additionally, websites could consider specifying separate robots.txt files or directives for different types of crawlers or user-agents to optimize their search engine rankings.

Interesting Module? Vote 👇

Voting helps other researchers find interesting modules.

Current Votes: 0

GoogleApi.ContentWarehouse.V1.Model.CompositeDocRobotsInfoList (google_api_content_warehouse v0.4.0)

List of robots info parsed for the user-agents other than the default used to crawl this page.

Attributes

  • newsRobotsInfo (type: GoogleApi.ContentWarehouse.V1.Model.IndexingConverterRobotsInfo.t, default: nil) -

Summary

Types

t()

Functions

decode(value, options)

Unwrap a decoded JSON object into its complex fields.

Types

Link to this type

t()

@type t() :: %GoogleApi.ContentWarehouse.V1.Model.CompositeDocRobotsInfoList{
  newsRobotsInfo:
    GoogleApi.ContentWarehouse.V1.Model.IndexingConverterRobotsInfo.t() | nil
}

Functions

Link to this function

decode(value, options)

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.