title: Prevent site data from being crawled and ripped
body: <p>I'm looking into building a content site with possibly thousands of different entries, accessible by index and by search.</p>
  
  <p>What are the measures I can take to prevent <strong>malicious crawlers</strong> from ripping off all the data from my site? I'm less worried about SEO, although I wouldn't want to block legitimate crawlers all together.</p>
  
  <p>For example, I thought about randomly changing small bits of the HTML structure used to display my data, but I guess it wouldn't really be effective.</p>