"Failing to add a certificate to Pidgin" test scenario always fails on devel since Sikuli fuzzy matching was implemented

The last commit where this test passed is 5f6a0f243098ebcfc1523bca9779be907c996d4f. The first commit where it failed is 369374f5406be8627d55272706f8c0e29c264da4. Sadly, a great number of changes happened in the meantime, including the Stretch 9.2 release.

On the picture I see the Desktop button in the sidebar is already selected => it has a blue background that the picture we’re looking for hasn’t. It looks like Pidgin used to forget the last opened directory, and now it remembers it. This might be caused by AppArmor changes in Linux 4.13.

I’ll investigate whether this is a regression in Tails itself, or an OK change that the test suite must adapt to. The stable branch is not affected currently, but it might be that upgrading to Linux 4.13 changes this so I’ll try to look into this in time for Tails 3.3.

Debug log:

    When I start "Pidgin Internet Messenger" via GNOME Activities Overview                                     # features/step_definitions/common_steps.rb:658
01:56:21.115394062: [log] ( Ctrl )  TYPE "#ENTER."
    And I see Pidgin's account manager window                                                                  # features/step_definitions/pidgin.rb:316
01:56:21.907412434: [log] CLICK on L(711,527)@S(0)[0,0 1024x768]
    And I close Pidgin's account manager window                                                                # features/step_definitions/pidgin.rb:320
01:56:21.909663542: calling as amnesia: cp "/usr/share/ca-certificates/mozilla/CNNIC_ROOT.crt" "/home/amnesia/.gnupg/test.crt"
01:56:22.107038917: call returned: [0, "", ""]
01:56:22.107221110: calling as amnesia: xdotool search --name 'Buddy List' windowactivate --sync
01:56:22.292349055: call returned: [0, "", ""]
01:56:24.420342894: [log] CLICK on L(322,183)@S(0)[0,0 1024x768]
01:56:24.420655251: [log] CLICK on L(361,241)@S(0)[0,0 1024x768]
01:56:25.850028480: [log] CLICK on L(643,272)@S(0)[0,0 1024x768]
01:56:27.196250066: [log] CLICK on L(145,286)@S(0)[0,0 1024x768]
01:56:28.512404560: [log] CLICK on L(123,135)@S(0)[0,0 1024x768]
01:56:30.822822108: [log] ( Alt )  TYPE "l"
[log]  TYPE "/home/amnesia/.gnupg/test.crt#ENTER."
    Then I cannot add a certificate from the "/home/amnesia/.gnupg" directory to Pidgin                        # features/step_definitions/pidgin.rb:478
01:56:31.564145776: [log]  TYPE "#ESC."
    When I close Pidgin's certificate import failure dialog                                                    # features/step_definitions/pidgin.rb:490
01:56:31.676633111: [log]  TYPE "#ESC."
    And I close Pidgin's certificate manager                                                                   # features/step_definitions/pidgin.rb:483
01:56:32.448411324: calling as amnesia: cp "/usr/share/ca-certificates/mozilla/CNNIC_ROOT.crt" "/lib/live/mount/overlay/home/amnesia/.gnupg/test.crt"
01:56:32.578446644: call returned: [0, "", ""]
01:56:32.578686397: calling as amnesia: xdotool search --name 'Buddy List' windowactivate --sync
01:56:32.727587193: call returned: [0, "", ""]
01:56:33.511186870: [log] CLICK on L(322,183)@S(0)[0,0 1024x768]
01:56:34.933252045: [log] CLICK on L(361,241)@S(0)[0,0 1024x768]
01:56:36.443727024: [log] CLICK on L(643,272)@S(0)[0,0 1024x768]
01:56:50.374061199: Found fuzzy candidate picture for GtkFileChooserDesktopButton.png with similarity 0.7
    Then I cannot add a certificate from the "/lib/live/mount/overlay/home/amnesia/.gnupg" directory to Pidgin # features/step_definitions/pidgin.rb:478
      FindFailed: can not find GtkFileChooserDesktopButton.png in S(0)[0,0 1024x768]
        Line 2171, in file Region.java
       (RuntimeError)
      ./features/support/helpers/sikuli_helper.rb:95:in `findfailed_hook'
      ./features/support/helpers/sikuli_helper.rb:146:in `rescue in block (2 levels) in new'
      ./features/support/helpers/sikuli_helper.rb:139:in `block (2 levels) in new'
      ./features/support/helpers/sikuli_helper.rb:168:in `wait_and_click'
      ./features/step_definitions/pidgin.rb:458:in `/^I cannot add a certificate from the "([^"]+)" directory to Pidgin$/'
      features/pidgin.feature:95:in `Then I cannot add a certificate from the "/lib/live/mount/overlay/home/amnesia/.gnupg" directory to Pidgin'
    When I close Pidgin's certificate import failure dialog                                                    # features/step_definitions/pidgin.rb:490
    And I close Pidgin's certificate manager                                                                   # features/step_definitions/pidgin.rb:483
    Then I cannot add a certificate from the "/live/overlay/home/amnesia/.gnupg" directory to Pidgin           # features/step_definitions/pidgin.rb:478

Feature Branch: test/improvements-from-buster-sprint

Related issues

• Related to #14929 (closed)
• Blocks #13240 (closed)
• Blocked by #14817 (closed)

Original created by @intrigeri on 14874 (Redmine)