User-agent: *
Disallow: /*.swf$
Disallow: /pages/
Disallow: /*.txt$
Disallow: /*.php$
Disallow: /*.as$