canonical-ci-engineering team mailing list archive

[Thomi Richards <thomi.richards@xxxxxxxxxxxxx>]

Hi,

On Wed, Nov 20, 2013 at 4:36 PM, Francis Ginther <
francis.ginther@xxxxxxxxxxxxx> wrote:

> This may not be so easy. Failing an MP because performance drops below
> X% is a pass/fail action. Providing a warning when it's not quite so
> bad is not. We'll need to iterate on how do make this visible to
> developers.
>


I imagined that this log would be encoded, and executed on the machine that
ran the tests. The subunit stream would contain the pass/fail criteria,
along with the actual values. The only hard part would be making it so each
run had access to the values from the previous run....

OR, we just hardcode the gold standard. Probably easier that way...

-- 
Thomi Richards
thomi.richards@xxxxxxxxxxxxx