Files
Tiber365/dist/robots.txt
becarta 3168826fa8 Add internationalization support with astro-i18next integration
- Implemented astro-i18next for multi-language support, including English, Dutch, and Italian.
- Configured default locale and language fallback settings.
- Defined routes for localized content in the configuration.
- Updated package.json and package-lock.json to include new dependencies for i18next and related plugins.
2025-05-23 15:10:00 +02:00

24 lines
397 B
Plaintext

User-agent: *
Allow: /
Allow: /services
Allow: /about
Allow: /contact
Allow: /404
Allow: /favicon.svg
Allow: /manifest.json
Disallow: /en
Disallow: /en/
Disallow: /nl
Disallow: /nl/
Disallow: /it
Disallow: /it/
# Sitemap
Sitemap: https://tiber365.it/sitemap.xml
# Crawl delay
Crawl-delay: 1
# Disallow admin or sensitive areas (if any in the future)
# Disallow: /admin/
# Disallow: /private/