TheEliteTimes
Start the day here

About our crawler

The Elite Times, published by ET Publications

The Elite Times operates an automated newsroom. To report the news we read publicly available web pages — the same pages any reader can open. This page explains who our crawler is and how to reach us.

Identity

  • User-Agent: EliteTimesBot/1.0 (+https://elitetimesnews.com/bot)
  • Operated by: ET Publications

What it does

  • Reads publicly accessible news and primary-source pages to inform our reporting.
  • Honors robots.txt (RFC 9309). If you disallow us, we stop.
  • Fetches slowly and politely — at most one request at a time per site, spaced out, and slower still if you set a Crawl-delay.
  • Identifies itself honestly on every request.

What it never does

  • It does not attempt to access anything behind a paywall or login.
  • It does not evade bot detection or disguise itself.
  • It does not render JavaScript or execute site code.
  • It does not collect personal data for tracking or profiling.

How your content is used

We read pages to inform original reporting and to verify facts, with attribution. We retain raw page copies only briefly (30 days) and extracted text for a limited period; both are kept privately, never republished wholesale.

Object or request removal

To ask us to stop crawling your site, add a Disallow for EliteTimesBot to your robots.txt, or use our content removal page. We respond within 7 days.