Comment 9 for bug 1902254

Revision history for this message
Mauricio Faria de Oliveira (mfo) wrote :

Groovy/xfstests
======

Original/patched kernel versions:

 $ grep -h ^PLATFORM xfstests.log.* | sort -u
 PLATFORM -- Linux/s390x mfo-s390x-groovy 5.8.0-25-generic #26+test20201026b1 SMP Mon Oct 26 19:02:54 -03 2020
 PLATFORM -- Linux/s390x mfo-s390x-groovy 5.8.0-25-generic #26-Ubuntu SMP Thu Oct 15 10:28:46 UTC 2020

Original kernel:
---

 $ VERSION='5.8.0-25-generic #26-Ubuntu'

Number of runs:

 $ grep -h -e ^Fail -e ^PLATFORM xfstests.log.* | grep -A1 "$VERSION" | grep -c Failures:
 12

 $ RUNS=12

Consistent fail set:

 $ grep -h -e ^Fail -e ^PLATFORM xfstests.log.* | grep -A1 "$VERSION" | grep ^Failures: | cut -d' ' -f2- | tr ' ' '\n' | sort | uniq -c | sort | grep -w $RUNS
      12 btrfs/153
      12 btrfs/208
      12 btrfs/213
      12 btrfs/219
      12 btrfs/220
      12 btrfs/221
      12 btrfs/222
      12 generic/260
      12 generic/286 <<-- Fails 15/18 in patched kernel
      12 generic/301
      12 generic/465 <<-- Fails 15/18 in patched kernel
      12 generic/610

Flaky fail set:

 $ grep -h -e ^Fail -e ^PLATFORM xfstests.log.* | grep -A1 "$VERSION" | grep ^Failures: | cut -d' ' -f2- | tr ' ' '\n' | sort | uniq -c | sort | grep -w -v $RUNS
       1 generic/297
       1 generic/371
       1 generic/528
       2 generic/298
       3 generic/166
      10 btrfs/010
      10 generic/074
      10 generic/142
      10 generic/143
      11 generic/133
      11 generic/175
      11 generic/475

Patched kernel:
---

 $ VERSION='5.8.0-25-generic #26+test20201026b1'

Number of runs:

 $ grep -h -e ^Fail -e ^PLATFORM xfstests.log.* | grep -A1 "$VERSION" | grep -c Failures:
 18

 $ RUNS=18

Consistent fail set:

 $ grep -h -e ^Fail -e ^PLATFORM xfstests.log.* | grep -A1 "$VERSION" | grep ^Failures: | cut -d' ' -f2- | tr ' ' '\n' | sort | uniq -c | sort | grep -w $RUNS
      18 btrfs/153
      18 btrfs/208
      18 btrfs/213
      18 btrfs/219
      18 btrfs/220
      18 btrfs/221
      18 btrfs/222
      18 generic/260
      18 generic/301
      18 generic/610

  No regressions.

Flaky fail set:

 $ grep -h -e ^Fail -e ^PLATFORM xfstests.log.* | grep -A1 "$VERSION" | grep ^Failures: | cut -d' ' -f2- | tr ' ' '\n' | sort | uniq -c | sort | grep -w -v $RUNS
       1 btrfs/020
       1 btrfs/028
       1 generic/118
       1 generic/198
       1 generic/215
       1 generic/241
       1 generic/246
       1 generic/297
       1 generic/371
       1 generic/564
       2 generic/298
       3 generic/247
       5 generic/166
      11 btrfs/010
      11 generic/074
      11 generic/142
      11 generic/143
      13 generic/475
      14 generic/175
      15 generic/286
      15 generic/465
      16 generic/133

  No regressions.