User-agent: * Disallow: /register.php Disallow: /admin.php Allow: /