WordPress.org

Français

Obtenir WordPress
WordPress.org

Plugin Directory

Étiquette de l’extension : crawler

Étiquette de l’extension : crawler

  • Email Address Encoder

    (160 notes en tout)

    Une extension légère qui protège les adresses e-mail des robots de collecte d’e-mails, en les encodant en entités décimales et hexadécimales.

    Till Krüss 100 000+ installations actives Testé avec 7.0.4

  • Robots.txt Editor

    (8 notes en tout)

    Robots.txt for WordPress

    Processby 10 000+ installations actives Testé avec 5.6.19

  • No-Bot Registration

    (28 notes en tout)

    Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

    Arnan 2 000+ installations actives Testé avec 6.9.7

  • Robots.txt rewrite

    (2 notes en tout)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1 000+ installations actives Testé avec 4.7.35

  • Marquee image crawler

    (1 notes en tout)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    gopiplus 600+ installations actives Testé avec 6.1.12

  • Block Archive.org via WordPress robots.txt

    (0 notes en tout)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 400+ installations actives Testé avec 6.9.7

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (4 notes en tout)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 400+ installations actives Testé avec 7.0.4

  • Bisteinoff SEO Robots.txt

    (4 notes en tout)

    An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

    Denis Bisteinov 400+ installations actives Testé avec 6.9.7

  • bodi0`s Bots visits counter

    (5 notes en tout)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ installations actives Testé avec 6.1.12

  • Block Chat GPT via robots.txt

    (1 notes en tout)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    apasionados 100+ installations actives Testé avec 6.3.10

  • Block eCommerce Assets via robots.txt

    (0 notes en tout)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ installations actives Testé avec 6.3.10

  • Findkit – Site Search

    (0 notes en tout)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 70+ installations actives Testé avec 6.9.0

  • Warmer – Cache Warmer and Cache Preload Crawler

    (6 notes en tout)

    Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.

    Atakan Oz 70+ installations actives Testé avec 7.0.4

  • AI Deny

    (1 notes en tout)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 40+ installations actives Testé avec 6.9.7

  • EdgeShaping Lite

    (0 notes en tout)

    Observe which AI bots visit which pages and when. WordPress implementation of the EdgeShaping framework.

    mareinterno 30+ installations actives Testé avec 7.0.4

  • Berq Markdown: Markdown Pages for AI & LLM Crawlers

    (0 notes en tout)

    Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …

    BerqWP 30+ installations actives Testé avec 7.0.4

  • Block Common Crawl via robots.txt

    (0 notes en tout)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ installations actives Testé avec 6.3.10

  • Boring Cache Warmup Lite

    (2 notes en tout)

    A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.

    chriskubisch 30+ installations actives Testé avec 7.0.4

  • Block Feed and Comments via robots.txt

    (0 notes en tout)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 20+ installations actives Testé avec 6.3.10

  • Azayem Bots Tracker – Bot Visits Logger

    (0 notes en tout)

    A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).

    botstracker 20+ installations actives Testé avec 6.9.7