ClaudeBot

An Anthropic crawler collecting content for model development. Claude-SearchBot and Claude-User have distinct search and user-requested access purposes.

SFT perspective

A Structure control: define rules for each crawler's purpose without equating training with citation.

Relevant pillars : Structure

Find this term in the complete glossary ↗