Nexus Core Technologies operates a specialized, automated web crawler designed to discover publicly available information regarding businesses, organizations, and public tenders that may benefit from our solar, software, or web development solutions.
How to Identify Our Crawler
We believe in full transparency. Our crawler does not disguise itself, spoof browsers, or hide its origin. In your server logs, it will always identify itself with the following User-Agent string:
NexusLeadBot/1.0 (+https://nexuscoretechnologies.co.za/leadbot; info@nexuscoretechnologies.co.za)
Crawler Behavior and Rules
Our crawler is engineered to be polite and strictly adheres to standard web protocols:
- Robots.txt Compliance: It strictly follows your
robots.txtdirectives. If it cannot reliably read that file, it aborts the crawl. - Rate Limiting: It implements built-in delays between requests to ensure it never affects your server's performance, bandwidth, or availability.
- Back-off Protocols: If your server returns standard error codes (e.g., 429 Too Many Requests, 500 Server Error), the crawler immediately stops and avoids your site for a minimum of 24 hours.
- No Authentication Bypassing: It never attempts to log in, bypass CAPTCHAs, or access gated, private, or secure content.
- Passive Operation: The bot only reads data. It does not send automated emails or attempt to fill out contact forms.
How to Block the Crawler
If you prefer that we do not index your public pages, you can easily block our crawler by adding the following standard directives to your website's robots.txt file:
User-agent: NexusLeadBotDisallow: /
Data Collection & Privacy
We collect data strictly on the basis of Legitimate Interest for B2B (Business-to-Business) operations, operating in compliance with the South African Protection of Personal Information Act (POPIA). For each potential lead, we store only:
- The registered business or organization name (or public tender title).
- The specific public URL where the information was discovered, along with a timestamp.
- A brief, internally generated summary regarding the potential relevance of our services.
What we do NOT collect: We intentionally avoid harvesting personal information of private individuals. We do not scrape private phone numbers, personal email addresses, ID numbers, or residential addresses. We only process general business contact endpoints (e.g., info@ or sales@) explicitly published for commercial inquiries.
Data Security & Sharing
- No Third-Party Sales: Your data is used exclusively by Nexus Core Technologies to offer our services. We never sell, rent, or trade your data to third-party data brokers.
- Secure Storage: All crawled data is stored on secure, access-controlled internal servers with encryption applied to sensitive fields and databases.
Data Retention Periods
We only keep data for as long as it is commercially relevant. After these periods, records are automatically and permanently deleted from our systems:
- Business/Corporate Leads: Up to 12 months from the date of the last crawler visit.
- Public Requests (Individuals/Sole Proprietors): Up to 90 days.
- Public Tenders: Until the official closing date, plus an administrative period of 90 days.
Your Rights: Exclude Your Site or Remove Data
Under POPIA, you have the right to request access to, correction of, or permanent deletion of your data. If you wish to have your domain permanently added to our internal blocklist, or if you want us to delete any existing data we hold regarding your organization without editing your robots.txt file, please contact us directly.
Submit a Data Subject Request
We aim to process and confirm all block and removal requests in writing within 10 business days.
Email a Removal RequestDirect Email: info@nexuscoretechnologies.co.za
Legal & Privacy: For comprehensive information on how we handle data and your rights under POPIA, please read our Privacy Policy.