Artificial Intelligence on Web Both service: Analysis of changes in web scanning

Article image Artificial Intelligence on Web Both service: Analysis of changes in web scanning
Article image Artificial Intelligence on Web Both service: Analysis of changes in web scanning
Publication date:14.09.2025
Blog category: Web Technology News

AI GPTBOT version from Openai and Claude from anthropic generate almost a billion requests on a Vercel network monthly. According to the data, GPTBOT has generated 569 million inquiries last month, while Claude was 370 million. It is also worth noting the contribution of Perplexitybot (24.4 million requests) and Applebot (314 million requests). Together, these AI scanners account for approximately 28% of the total GoogleBot, which is 4.5 billion inquiries. This opens up new prospects for SEO.

"Basic AI scanners do not render JavaScript, although they charge javascript files. AI scanners are often ineffective because Catgpt and Claude spent more than 34% (57.7%) while Claude is more focused on the image (35.17%). "

🚀 Based on recent data from Vercel and Web Almanac, there are three ways to optimize for AI scanners. In particular, it is important to consider the Randing server, content and delivery structure and technical aspects, such as the maintenance of updated MAPs of the site, the implementation of appropriate radiation, the use of URL sequential templates and regular audit of 404 errors.

  • 📌 AI scanners make up a large part of the total amount of requests on the network.
  • 📌 AI scanners do not renegiate javascript, but charge JavaScript files.
  • 📌 AI scanners can be ineffective by spending a considerable amount of inquiries on inaccessible pages.
  • 📌 The type of content on which AI scanners concentrate may vary.
  • 📌 AI scanners focus on specific regions.

Often asked questions

1. What is AI scanners?

AI scanners are web bots that use artificial intelligence to generate requests on the network.

2. Do AI scanners affect SEO?

Yes, AI scanners can affect SEO because they create a considerable amount of requests on the network.

3. How do AI scanners affect JavaScript rendering?

AI scanners do not perform javascript, but they charge JavaScript files.

4. How to optimize a website for AI scanners?

To optimize the website for AI scanners, you can use Randing server, structuring the content clearly and semantically, as well as holding the updated Maps of the site.

🧩 Summary: Artificial intelligence is increasingly affected by web scanning, and AI scanners become important players in this process. Optimization of websites for these bots may require changes in web architecture, including the use of a rendering server and content structuring. Despite the current restrictions on AI scanners, their opportunities can expand in the future.
🧠 Own considerations: Artificial intelligence already transforms many fields of technology, and web scanning is no exception. This opens up new opportunities for SEO, but also puts certain challenges. It is important not only to adapt to these changes, but also to understand how they can affect the future of web technologies.

Comments

BugHunter Avatar
Зловмисні ботозалежні моделі — це не унікальна знахідка, а еволюція зручностей. Але якщо AI-сканери не можуть обробити JavaScript і валяться на 404, то про які нові SEO-можливості йдеться? Може, краще зосередитися на великих змінах в контенті, а не на кумедних цифрах? Не ведіться на тренди, це лише черговий гіпердосліджений хайп.
14.09.2025 08:00 BugHunter