# robots.txt generated by swc # # Known Bots that stress the site # ------------------------------------------------ Sitemap: http://www.maitatoyota.com/sitemap.xml Sitemap: http://www.maitatoyota.com/videositemap.xml User-agent: DotBot Disallow: / User-agent: DotBot/1.1 Disallow: / # 070130 - Majestic12 Distributed Search Engine denied due to load/security User-Agent: MJ12bot Disallow: / User-agent: Linknzbot 2004 User-agent: Linknzbot* User-agent: Linknzbot User-agent: Microsoft URL Control - 5.01.4511 User-agent: Microsoft URL Control - 6.00.8169 User-agent: Microsoft URL Control - 6.01.9782 User-agent: Microsoft URL Control* User-agent: Microsoft URL Control User-agent: aipbot/1.0 User-agent: aipbot* User-agent: aipbot User-agent: LWP* User-agent: LWP User-agent: NutchCVS/0.06-dev User-agent: Nutch* User-agent: Nutch Disallow: / # # General Bad Bots # ------------------------------------------------ User-agent: Gigabot User-agent: Scrubby User-agent: Robozilla User-agent: Nutch User-agent: ia_archiver User-agent: psbot User-agent: asterias User-Agent: OmniExplorer_Bot User-agent: ShopWiki/1.0 User-agent: ShopWiki User-agent: DotBot User-agent: DotBot/1.1 User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 User-agent: Crescent Internet ToolPak HTTPOLE Control v.1.0 User-agent: DISCo Pump 3.2 User-agent: DISCoFinder User-agent: Download Demon/3.2.0.8 User-agent: dumbot User-agent: eCatch/3.0 User-agent: EmailWolf User-agent: EroCrawler User-agent: ExtractorPro User-agent: FlashGet User-agent: FlashGet WebWasher 3.2 User-agent: FrontPage [NC,OR] User-agent: GetRight/4.3 User-agent: GetRight/4.5 User-agent: GetRight/4.5a User-agent: GetRight/4.5b User-agent: GetRight/4.5b3 User-agent: GetRight/4.5b6 User-agent: GetRight/4.5b7 User-agent: GetRight/4.5c User-agent: GetRight/4.5d User-agent: GetRight/4.5e User-agent: GetRight/5.0beta1 User-agent: GetRight/5.0beta2 User-agent: Go!Zilla (www.gozilla.com) User-agent: Go-Ahead-Got-It User-agent: grub User-agent: grub-client User-agent: Harvest User-agent: HMView User-agent: httplib User-agent: HTTrack User-agent: HTTrack [NC,OR] User-agent: Image Stripper User-agent: Image Sucker User-agent: InfoNaviRobot User-agent: Internet Ninja 4.0 User-agent: Internet Ninja 5.0 User-agent: Internet Ninja 6.0 User-agent: JetCar User-agent: JOC Web Spider User-agent: Kenjin Spider User-agent: Keyword.Density User-agent: larbin User-agent: larbin (samualt9@bigfoot.com) User-agent: larbin samualt9@bigfoot.com User-agent: larbin_2.6.2 kabura@sushi.com User-agent: larbin_2.6.2 larbin@correa.org User-agent: larbin_2.6.2 larbin2.6.2@unspecified.mail User-agent: larbin_2.6.2 listonATccDOTgatechDOTedu User-agent: LexiBot User-agent: libWeb/clsHTTP User-agent: libWeb/clsHTTPDisallow: / User-agent: LinkextractorPro User-agent: LinkScan/8.1a Unix User-agent: LinkScan/8.1a Unix Disallow: / User-agent: LinkScan/8.1a.Unix User-agent: LinkWalker User-agent: LNSpiderguy User-agent: lwp-trivial User-agent: lwp-trivial/1.34 User-agent: Mass Downloader User-agent: Mass Downloader/2.2 User-agent: Mata Hari User-agent: Mata.Hari User-agent: MIDown tool User-agent: MIIxpc User-agent: MIIxpc/4.2 User-agent: Mister PiX User-agent: Mister Pix II 2.01 User-agent: Mister Pix II 2.02a User-agent: Mister PiX version.dll User-agent: Mister.PiX User-agent: moget User-agent: moget/2.1 User-agent: MSIECrawler User-agent: NearSite User-agent: Net Vampire User-agent: Net Vampire/3.0 User-agent: NetAnts User-agent: NetAnts/1.25 User-agent: NetSpider User-agent: Offline Explorer/1.7 User-agent: Offline Explorer/1.9 User-agent: Offline Explorer/2.0 User-agent: Offline Explorer/2.4 User-agent: Openbot User-agent: Openfind User-agent: Openfind data gathere User-agent: pavuk User-agent: pcBrowser User-agent: Python-urllib User-agent: Radiation Retriever 1.1 User-agent: RealDownload User-agent: RealDownload/4.0.0.40 User-agent: RealDownload/4.0.0.41 User-agent: RealDownload/4.0.0.42 User-agent: ReGet User-agent: SuperBot User-agent: SuperHTTP User-agent: SuperHTTP/1.0 User-agent: Surfbot User-agent: Szukacz/1.4 User-agent: Teleport Pro User-agent: Teleport Pro/1.29.1634 User-agent: Teleport Pro/1.29.1847 User-agent: TeleportPro User-agent: Telesoft User-agent: TheNomad User-agent: TightTwatBot User-agent: toCrawl/UrlDispatcher User-agent: True_Robot/1.0 User-agent: TurnitinBot User-agent: TurnitinBot/1.5 User-agent: URL Control User-agent: URLy Warning User-agent: VoidEYE User-agent: Web.Image.Collector User-agent: WebAuto User-agent: WebAuto/3.40 (Win98; I) User-agent: WebBandit User-agent: WebBandit/3.50 User-agent: WebCopier v2.8 User-agent: WebCopier v3.0.1 User-agent: WebCopier v3.2a User-agent: WebEMailExtrac.* User-agent: WebEnhancer User-agent: WebFetch User-agent: WebGo IS User-agent: WebmasterWorldForumBot User-agent: WebReaper User-agent: WebReaper [info@webreaper.net] User-agent: WebReaper [webreaper@otway.com] User-agent: WebReaper v9.1 - www.otway.com/webreaper User-agent: WebReaper v9.7 - www.webreaper.net User-agent: WebReaper vWebReaper v7.3 - www,otway.com/webreaper User-agent: WebSauger User-agent: WebSauger 1.20b User-agent: WebSauger 1.20j User-agent: WebSauger 1.20k User-agent: Website Quester User-agent: Website Quester - www.asona.org User-agent: Website Quester - www.esalesbiz.com/extra/ User-agent: Website.Quester User-agent: Webster Pro User-agent: Webster.Pro User-agent: WebZip/4.0 User-agent: WebZIP/4.0 (http://www.spidersoft.com) User-agent: WebZIP/4.1 (http://www.spidersoft.com) User-agent: WebZIP/4.21 User-agent: WebZIP/4.21 (http://www.spidersoft.com) User-agent: WebZIP/5.0 User-agent: WebZIP/5.0 (http://www.spidersoft.com) User-agent: WebZIP/5.0 PR1 (http://www.spidersoft.com) User-agent: Wget User-agent: Wget/1.5.2 User-agent: Wget/1.7 User-agent: Wget/1.8.2 User-agent: WWW-Collector-E User-agent: WWWOFFLE User-agent: Zeus User-agent: Zeus 44238 Webster Pro V2.9 Win32 User-agent: Zeus 63567 Webster Pro V2.9 Win32 User-agent: Zeus 82016 Webster Pro V2.9 Win32 User-agent: Zeus 90872 Webster Pro V2.9 Win32 User-agent: Zeus 97371 Webster Pro V2.9 Win32 User-agent: Zeus Link Scout User-agent: Black Hole User-agent: Titan User-agent: WebStripper User-agent: NetMechanic User-agent: CherryPicker User-agent: EmailCollector User-agent: EmailSiphon User-agent: WebBandit User-agent: EmailWolf User-agent: ExtractorPro User-agent: CopyRightCheck User-agent: Crescent User-agent: Wget User-agent: SiteSnagger User-agent: ProWebWalker User-agent: CheeseBot User-agent: Teleport User-agent: TeleportPro User-agent: MIIxpc User-agent: Telesoft User-agent: Website Quester User-agent: WebZip User-agent: moget/2.1 User-agent: WebZip/4.0 User-agent: WebSauger User-agent: WebCopier User-agent: NetAnts User-agent: Mister PiX User-agent: WebAuto User-agent: TheNomad User-agent: WWW-Collector-E User-agent: RMA User-agent: libWeb/clsHTTP User-agent: asterias User-agent: httplib User-agent: turingos User-agent: spanner User-agent: InfoNaviRobot User-agent: Harvest/1.5 User-agent: Bullseye/1.0 User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 User-agent: CherryPickerSE/1.0 User-agent: CherryPicker /1.0 User-agent: WebBandit/3.50 User-agent: NICErsPRO User-agent: Microsoft URL Control - 5.01.4511 User-agent: DittoSpyder User-agent: Foobot User-agent: WebmasterWorldForumBot User-agent: SpankBot User-agent: BotALot User-agent: lwp-trivial/1.34 User-agent: lwp-trivial User-agent: Wget/1.6 User-agent: BunnySlippers User-agent: Microsoft URL Control - 6.00.8169 User-agent: URLy Warning User-agent: Wget/1.5.3 User-agent: LinkWalker User-agent: cosmos User-agent: moget User-agent: hloader User-agent: humanlinks User-agent: LinkextractorPro User-agent: Offline Explorer User-agent: Mata Hari User-agent: LexiBot User-agent: Web Image Collector User-agent: The Intraformant User-agent: True_Robot/1.0 User-agent: True_Robot User-agent: BlowFish/1.0 User-agent: JennyBot User-agent: MIIxpc/4.2 User-agent: BuiltBotTough User-agent: ProPowerBot/2.14 User-agent: BackDoorBot/1.0 User-agent: toCrawl/UrlDispatcher User-agent: WebEnhancer User-agent: TightTwatBot User-agent: suzuran User-agent: VCI WebViewer VCI WebViewer Win32 User-agent: VCI User-agent: Szukacz/1.4 User-agent: QueryN Metasearch User-agent: Openfind data gathere User-agent: Openfind User-agent: Xenu's Link Sleuth 1.1c User-agent: Xenu's User-agent: Zeus User-agent: RepoMonkey Bait & Tackle/v1.01 User-agent: RepoMonkey User-agent: Zeus 32297 Webster Pro V2.9 Win32 User-agent: Webster Pro User-agent: EroCrawler User-agent: LinkScan/8.1a Unix User-agent: Keyword Density/0.9 User-agent: Kenjin Spider User-agent: Cegbfeieh Disallow: / User-agent: panscient.com Disallow: /nmvt.cfm User-agent: * Crawl-delay: 20 Disallow: /images Disallow: /admin Disallow: /contactswc.cfm Disallow: /bak Disallow: /customgallery Disallow: /enter Disallow: /event_cal Disallow: /pcolor Disallow: /revamp Disallow: /revamp1 Disallow: /stats Disallow: /system Disallow: /temp Disallow: /templates Disallow: /manageSubs.cfm Disallow: /newbasket.cfm