Skip to main content
ZenQraftAgentic testing, end to end

Testing everything is not a strategy.

ZenQraft is an all-in-one agentic testing framework. Agents work out what your system actually needs — then build it, run it, and keep it current.

Where quality engineering breaks

Most teams do not have a testing problem.

They have a strategy problem that shows up as a testing problem. These are the three shapes it takes.

Coverage theatre

A large suite that reports green and catches nothing anyone cares about.

  • Coverage percentage as the goal, not risk
  • Thousands of assertions on trivial paths
  • Flaky tests muted rather than fixed
  • Nobody can say what the suite actually protects

Late-stage discovery

Performance, security and accessibility arrive as a pre-launch audit, not a practice.

  • Load testing the week before go-live
  • Pen test findings that need architecture changes
  • Accessibility retrofitted after the UI is frozen
  • Every finding is now the most expensive it will ever be

Automation without a strategy

Frameworks chosen by preference, then abandoned when they stop paying rent.

  • UI tests doing work an API test should do
  • No test data strategy, so environments drift
  • CI takes an hour, so people stop running it
  • Two abandoned frameworks and a third being trialled

“We have thousands of tests and we still ship regressions.”

“Our pipeline is red most mornings and nobody trusts it.”

“Nobody can tell me what our test suite actually guarantees.”

— What engineering leaders tell us before a ZenQraft assessment.

The ZenQraft arc

Assess. Strategise. Recommend. Automate. Operate.

Five stages, each with an artefact you can hold. Engagements can start at any stage — most start at Assess, because most teams do not yet know what they have.

Assess

What you actually have.

We inventory the real state of quality: what is tested, what is claimed, and the distance between them. Suite composition, flake rate, pipeline duration, escaped-defect history, environment and test-data reality.

You receiveQuality baseline report

What that means in practice

  • Test inventory mapped to risk, not to folders
  • Flake and failure analysis across recent CI history
  • Escaped-defect review — what reached production and why
  • Tooling and environment audit
Agentic testing

One package, not five tools.

ZenQraft is an agentic testing framework: it decides the strategy, generates the tests and the framework around them, writes the instructions your team works from, and keeps the reports and dashboards current. One agent per stage of the arc — the same five stages above, each with an artefact you can hold.

Assess

Inventory agent

Reads the repository and recent CI history rather than a spreadsheet. Maps every test to the behaviour it protects, and computes flake rate, pipeline duration and escaped-defect history from what actually ran.

ProducesQuality baseline report
Strategise

Strategy agent

Proposes the layer allocation — what belongs in unit, contract, API, UI or exploratory — with the cost argument attached. You get a draft to argue with in an afternoon instead of a fortnight.

ProducesTest strategy document
Recommend

Prioritisation agent

Ranks findings by risk retired per unit of effort, separates quick wins from structural work, and states what each recommendation costs to hold. Every item is arguable on its own.

ProducesPrioritised roadmap
Automate

Generation agent

Writes the framework, not just the tests: page objects, contract tests, data builders, CI wiring and the instructions a new engineer needs to add a case on day one. In your stack, in your conventions.

ProducesWorking suite in your CI
Operate

Triage agent

Runs on a schedule, separates app bugs from environment noise and spec drift, and keeps the dashboards current. Verdicts reach humans; the noise stays in the agent.

ProducesDashboards and trend reporting
Built on MCP

An agent that cannot reach your system is writing fiction.

ZenQraft’s agents connect through the Model Context Protocol, the open standard for giving a model real tools. That is the difference between an agent that reports a suite as passing because the code looks correct, and one that drove the browser and watched it happen. We have measured that gap: parallel browser agents cleared a 200-case suite in 28 minutes against 90 sequential, and the run that silently fell back to reading source returned green results worth far less than they appeared.

Browser

Agents drive a real browser — navigate, click, fill, snapshot, evaluate — so a passing test means the journey worked, not that the component compiled.

Repository and CI

Reading the diff, the pipeline history and the failure output is what makes triage possible. An agent without this is guessing at why a build went red.

Observability

Latency, error rates and logs turn "the test passed" into "the release is healthy" — the difference between a green suite and a working system.

Your own tools

Issue trackers, test management, internal services. MCP is an open protocol, so the same agents reach whatever your team already runs.

The agents do the volume. A senior quality engineer still owns the risk model, the non-goals and the release call — because those are judgements, and an agent that makes them unsupervised is the failure mode this framework exists to prevent.

Six disciplines, one strategy

End to end means all of it, at the right layer.

Each discipline answers a different question and belongs at a different point in the pipeline. Treating them as one undifferentiated “testing” budget is how teams end up with slow suites that miss the things that matter.

UI

Does the journey a customer actually takes still work?

Thin and deliberate. UI tests cover journeys that cannot be proven cheaper at a lower layer — nothing else.

Runs at

Per PR (smoke) · nightly (full journeys)

Typically

  • Playwright
  • Cypress
  • Selenium

API

Do the contracts between services hold?

Where most functional coverage belongs. Fast, stable, and precise about which side of an integration broke.

Runs at

Per commit · contract checks on every deploy

Typically

  • REST Assured
  • Pact
  • Postman/Newman
  • Karate

Mobile

Does it hold on real devices, not just simulators?

Device-matrix testing driven by your actual analytics — not the newest handset in the office.

Runs at

Per release candidate · nightly on device cloud

Typically

  • Appium
  • Espresso
  • XCUITest
  • BrowserStack

Performance

What breaks first, and at what load?

Baselined early and tracked as a trend. Finding the ceiling a week before launch is finding it too late.

Runs at

Baseline in CI · full profile per release

Typically

  • k6
  • JMeter
  • Gatling
  • Lighthouse CI

Security

What would an attacker reach first?

Shifted into the pipeline — dependency, secret and static analysis on every commit, with depth testing at milestones.

Runs at

Every commit (SAST/SCA) · milestone pen tests

Typically

  • OWASP ZAP
  • Snyk
  • Semgrep
  • Trivy

Accessibility

Can everyone actually use it?

Automated checks catch roughly a third of WCAG issues. The rest needs keyboard and screen-reader testing, so we do both.

Runs at

Per PR (automated) · manual audit per milestone

Typically

  • axe-core
  • Pa11y
  • Lighthouse
  • NVDA / VoiceOver

Tooling is listed as typical, not fixed. The strategy chooses the stack — picking the framework first is how teams end up with two abandoned ones.

What we hold to

Six positions you can argue with.

If a principle cannot be disagreed with, it is not a principle. These are ours.

01

Risk decides coverage, not percentage

A coverage number tells you how much code ran, not whether the business is protected. We map tests to the failures you cannot afford, then let the percentage land where it lands.

02

Test at the cheapest layer that proves it

If a contract test proves it, a UI test should not. The pyramid is not dogma — it is a cost argument. Every test pushed down a layer runs faster, breaks less and points more precisely at the cause.

03

A flaky test is a broken test

Muting flake is how suites lose their audience. We hold a flake budget and treat breaching it as a defect, because a suite nobody trusts is worse than no suite — it costs money and buys nothing.

04

Non-functional is not a phase

Performance, security and accessibility belong in the pipeline from week one. Discovering them in a pre-launch audit means every finding needs a change you no longer have time to make.

05

The team keeps the framework

We build with your engineers in the room and hand over documentation and pairing, not a repository. Automation that only its author can extend has a shelf life measured in months.

06

Say what you are not testing

A strategy that claims to cover everything covers nothing in particular. We write the non-goals down, so the gaps are decisions on record rather than discoveries in production.

Start with the baseline

Find out what your suite actually guarantees.

A ZenQraft assessment gives you a quality baseline report and a prioritised roadmap — whether or not we build the automation afterwards.