BC Observatoryunofficial, made by waldo
code change · fixAL Developmentofficial - Microsoftreviewed - checked by Opus

#110 review: stop reference-less agent findings in privacy and UI/accessibility leaves

The privacy and UI/accessibility review skills now report only findings backed by a BCQuality knowledge file. Concerns without a reference are omitted instead of being emitted with empty references, which cuts false positives at the cost of at most one true positive.

Open in Claude110.mdPull request #110

Pull request · merged into main on 2026-07-16 by gggdttt · 2 files (+2 -2), 2 AL · fix · tier official · reviewed (checked by Opus)

What changed

  • al-privacy-review and al-ui-review are limited to knowledge-backed findings
  • Reference-less agent findings caused 86% of all false positives in the online eval
  • Expected to remove about 19 false positives and lose at most 1 true positive
  • Style, performance and upgrade leaves keep their agent-finding channel for now
  • Only the instructions change; the output contract stays the same
  • Behaviour changes for users or extensions.

AL objects touched

  • microsoft/skills/review/al-privacy-review.md: modified, not in the BC? snapshot
  • microsoft/skills/review/al-ui-review.md: modified, not in the BC? snapshot

Context

  • Systems: development

Source: metadata of a merged pull request in microsoft/BCQuality (bcquality): title, labels, changed paths and counts, with a summary in our words. No source text and no description beyond one short quote (D10, D61).