{"id":20069,"date":"2026-09-25T08:50:42","date_gmt":"2026-09-25T08:50:42","guid":{"rendered":"https:\/\/internetcommunication.fr\/+\/?post_type=glossary&#038;p=20069"},"modified":"2026-09-25T08:50:42","modified_gmt":"2026-09-25T08:50:42","slug":"crawlers-ia","status":"publish","type":"glossary","link":"https:\/\/www.internetcommunication.fr\/+\/glossary\/crawlers-ia","title":{"rendered":"Crawlers IA"},"content":{"rendered":"<p>Les crawlers IA sont les robots qui explorent le web pour entra\u00eener les mod\u00e8les d&rsquo;IA ou alimenter leurs r\u00e9ponses en temps r\u00e9el (GPTBot et OAI-SearchBot d&rsquo;OpenAI, ClaudeBot d&rsquo;Anthropic, PerplexityBot\u2026). Le fichier robots.txt permet de les autoriser ou de les bloquer individuellement.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Les crawlers IA sont les robots qui explorent le web pour entra\u00eener les mod\u00e8les d&rsquo;IA ou alimenter leurs r\u00e9ponses en temps r\u00e9el (GPTBot et OAI-SearchBot d&rsquo;OpenAI, ClaudeBot d&rsquo;Anthropic, PerplexityBot\u2026). Le fichier robots.txt permet de les autoriser ou de les bloquer individuellement.<\/p>\n","protected":false},"author":1,"featured_media":0,"menu_order":0,"template":"","meta":{"footnotes":""},"class_list":["post-20069","glossary","type-glossary","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.internetcommunication.fr\/+\/wp-json\/wp\/v2\/glossary\/20069","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.internetcommunication.fr\/+\/wp-json\/wp\/v2\/glossary"}],"about":[{"href":"https:\/\/www.internetcommunication.fr\/+\/wp-json\/wp\/v2\/types\/glossary"}],"author":[{"embeddable":true,"href":"https:\/\/www.internetcommunication.fr\/+\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":1,"href":"https:\/\/www.internetcommunication.fr\/+\/wp-json\/wp\/v2\/glossary\/20069\/revisions"}],"predecessor-version":[{"id":20082,"href":"https:\/\/www.internetcommunication.fr\/+\/wp-json\/wp\/v2\/glossary\/20069\/revisions\/20082"}],"wp:attachment":[{"href":"https:\/\/www.internetcommunication.fr\/+\/wp-json\/wp\/v2\/media?parent=20069"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}