Google从2026年8月底起调整了搜索结果的链接展示方式1。过去直接暴露的目标URL现已被替换为google.com/goto格式的重定向链接1,用户点击后才会跳转至真实网址1。
这一变化对网络数据采集造成了影响1。新重定向链接中的url参数采用Google专有的自定义编码方式,而非简单的base641。获取真实URL需要向Google发送HEAD请求并从响应头的Location字段中读取,而不能直接跟随重定向1。该措施的目的在于阻止AI爬虫和SEO爬虫批量提取搜索结果URL以构建自有索引1。这项改变在登出或隐私浏览模式中已广泛展示1,搜索API服务商Autom已更新其系统以适配新格式1。
Google has implemented new anti-scraping measures in its search results, replacing direct target URLs with redirect links beginning in late August 2026.1 The search engine now uses the format google.com/goto?url=... instead of the previous google.com/url?q= format to display search result links.1
The URL parameter in the new format employs Google's proprietary custom encoding rather than standard base64 encoding.1 To retrieve the actual destination URL, users and automated systems must send a HEAD request to obtain the address from the Location response header, rather than simply following the redirect.1 This change has been rolled out widely in logged-out and private browsing modes as of late August 2026.1
The measure targets the extraction of search result URLs at scale by AI crawlers and SEO scrapers attempting to build their own search indexes.1 API service providers such as Autom have updated their pipelines to accommodate this structural change.1
评论
还没有评论,欢迎留下第一条。