Watchdog
- Claim
- Blind test, 3 of 3 planted bugs found, 0 false positives, on one 8‑bit watchdog.
- Result
- 3 of 3 planted bugs foundall planted bugs
- 0 false positivesno finding outside the plant
- 1 design38 lines of Verilog, 1,271 bytes, 8-bit
Learn moreShow less
- Method
Blind meant this: an examiner wrote the watchdog RTL with three bugs planted and sealed the answer key. We received the RTL and a four-sentence English specification, and nothing else.
Twelve properties were generated from the specification. The owner of the specification accepted eleven as stating it.
Formal checking found six violations of accepted properties. Each one was reproduced by an independent replay of the unchanged RTL against the unchanged property.
The report was then graded against the sealed key: the six findings map to the three planted bugs, and none points at behaviour that was not planted. Five further properties hold by induction.
- Limits
- One design: 38 lines of Verilog, 1,271 bytes, an 8-bit counter with a programmable timeout.
- Three planted bugs and a four-sentence specification.
- The properties were accepted by the owner of the specification before any verdict was graded.
- Trust boundary
The replay proves that the unchanged RTL violates each accepted property.
That each property states the intended behaviour rests on its acceptance by the owner of the specification. The pack carries each property beside the specification so you can read them together.
- Date
- Check pack
Download the watchdog check pack zip, 21 kB
The RTL, the specification, the six formal tasks with their accepted properties, the recorded verdicts and counterexample traces, one replay command, SHA-256 of every file.
Replay:
sh replay.shSHA-256
fe54982d8060c34c7bf98ceb2fc0522b51ef4b97507c9a0bb771d1605956e1d6