VZU Portfolio · web-scraper
Ethical, rate-aware, schema-typed. The audit trail is the scraper log.
A web scraper surface on the Netwit Agentic OS runtime. Ethical, rate-aware, schema-typed scraping with an audit trail, MCP contract, and review before commit.
The Web Scraper is a web-scraping surface on the Netwit Agentic OS runtime. Schema-typed, rate-aware, ethical by default. The audit trail is the scraper log. The review is the reviewer agent. The agent describes the target data as a schema, the scraper writes the data as the schema. robots.txt is respected, the host is not exhausted, the ethical posture is explicit. The reviewer agent reads the diff before the data is committed. The Web Scraper is a tool inside the VZU family, operated by Virtual Zero Unbound Inc.
What ships
Lead capability
02
The agent describes the target data as a schema, the scraper writes the data as the schema. The diff is reviewable. The override is logged.
03
Respects robots.txt, throttles per host, retries on 429, surfaces the rate-limit log. The agent does not exhaust the host. The override is logged.
04
Respects the site's terms, doesn't bypass CAPTCHAs, doesn't scrape behind a login without explicit operator consent. The reviewer agent reads the policy before the scrape runs.
05
Any agent in the Netwit runtime can request a scrape via the typed scraper MCP server. The contract is the integration story.
06
Missing fields, schema drift, rate-limit breaches, ethical-posture violations — all flagged by the reviewer agent before the data is committed.
The deep view
The point of the Web Scraper is the schema. The agent describes the target data as a typed schema — fields, types, validation. The scraper writes the data as the schema. The diff is reviewable. When the target page changes, the reviewer agent flags the schema drift before the data is allowed to commit. The override is logged. The audit trail is the scraper log.
Rate-awareness is a default, not a setting. robots.txt is respected. The scraper throttles per host, retries on 429, surfaces the rate-limit log to the operator. The agent does not exhaust the host. The override is logged. The reviewer agent reads the rate-limit posture before the scrape runs. The policy is explicit.
The ethical posture is the part other scrapers skip. The Web Scraper respects the site's terms. It does not bypass CAPTCHAs. It does not scrape behind a login without explicit operator consent. The reviewer agent reads the policy before the scrape runs. The override is logged. The audit trail stays honest.
The MCP server is the integration story. Any agent in the Netwit runtime can request a scrape via the typed scraper MCP server. The contract is the contract. The contract drift is caught by the reviewer agent before the call is allowed. The scraper log lands in the repo — every request, every response, every rate-limit event, every schema change. The operator can read it, version it, branch it, hand it to another team.
The process
The agent reads the target site, proposes a schema, surfaces the rate-limit posture and the ethical posture. The reviewer agent reads the policy before the scrape runs.
Rate limit, retry on 429, CAPTCHA posture, login posture. The agent does not bypass CAPTCHAs. The operator confirms the policy before the scrape runs.
The scraper runs against the target, throttles per host, logs every request. The reviewer agent checks the diff. Schema drift is flagged before commit.
The data lands in the destination. The scraper log is the audit trail. Every request, every response, every rate-limit event, every schema change. The override is logged.
Where the work happens
The Web Scraper surface is operated out of three VZU offices. The reviewer agent reads the policy before the scrape runs. The audit trail of the scrape is the scraper log, in the repo, versioned, branchable, hand-off-able.
In production
Market intel
Schema-typed, rate-aware, diff in the repo, audit trail current. The reviewer agent caught a schema drift on week 6 — the competitor added a new field; the team updated the schema before the next run.
Recruiting
Schema-typed, rate-aware, MCP-integrated into the CRM. The reviewer agent reads the policy before the scrape runs. The override was logged once when the policy needed a manual review for a new job board.
Research
Schema-typed, rate-aware, with a reviewer agent flagging schema drift. The scraper log is the audit trail. The contract is the contract. The override is logged.
Other VZU tools
On the runtime
The Web Scraper is a configuration of the Netwit Agentic OS runtime. The runtime enforces RBAC at the agent level, ships the audit trail by default, and deploys in cloud, hybrid, or on-prem modes. The scraper log in the repo is the audit trail.
The VZU platform, in detail →Questions
Get in touch
Email the team. Reply in one business day. The pilot is priced, the policy is configured, the ship date is real.