User-agent: ia_archiver
Disallow: /

User-agent: *
Crawl-delay: 1
Disallow: /bt-srv/afbtmediakit/
Disallow: /bt-dyn/content/asiaafrica/
Disallow: /bt-dyn/content/atlantis/
Disallow: /bt-dyn/content/atlantis/lemuria/
Disallow: /bt-dyn/content/caribbean/
Disallow: /bt-dyn/content/destinations/latinamerica/
Disallow: /bt-dyn/content/destinations/latinamerica/mexico/
Disallow: /bt-dyn/content/europe/
Disallow: /bt-dyn/content/gallery/
Disallow: /bt-dyn/content/girlfriendgetaways/
Disallow: /bt-dyn/content/roadtrips/
Disallow: /bt-dyn/content/strategies/familytravel/
Disallow: /bt-dyn/content/strategies/lodging/
Disallow: /bt-dyn/content/strategies/other/
Disallow: /bt-dyn/content/tips/readertips/
Disallow: /bt-dyn/content/tips/tripcoach/
Disallow: /bt-dyn/content/usandcanada/
Disallow: /bt-srv/marketplace/
Disallow: /bt-srv/test/

Sitemap: http://www.budgettravel.com/sitemap.xml.gz