# All robots will spider the domain User-agent: * Disallow: User-agent: TurnitinBot Disallow: / User-agent: NaverBot Disallow: / User-agent: TutorGig Disallow: /