User-agent: Scrapy
Allow: /

User-agent: *
Disallow: /artikkel/
Disallow: /infoskjerm/