User-agent: * Disallow: /admin/ Disallow: /images/ Disallow: /assets/ Disallow: /vendor/ Disallow: /vendors/ Disallow: /upload/ Disallow: /storage/ Disallow: /auth/ Disallow: /admin_* Disallow: /auth_*