User-agent: *
Disallow: /wp-admin/
Disallow: /trackback/
Disallow: /xmlrpc.php
Disallow: */feed/
Disallow: */category/
Disallow: */tag/
Disallow: */author/
Disallow: /category/media-mention/page/

User-agent: dotbot
Disallow: /