This was previously passing because our CI configuration was actually
testing 6.x instead of 5.x. Luckily this is the only problem which
hadn't been caught since this was introduced.
This commit is just moving the tests to their new names. The config,
packge and issue test suites have been removed and the tests from these
will be incorporated into the oss and xpack tests.
oss: Standard elasticsearch-oss role with idempotency test
oss-upgrade: Upgrade from previous minor version oss to current minor version oss
oss-to-xpack-upgrade: Upgrade from previous minor version oss to current minor version xpack
xpack: Standard elasticsearch (with xpack) role with idempotency test
xpack-upgrade: Upgrade from previous minor version xpack to current minor version xpack
multi: Tests multiple instances of elasticsearch on a single machine
All of these were not actually defined in the final play of the testing
role however were leftover by the previous run or default install. The
changes in 6.3 moved the locations of these files to a different
directory causing these tests to fail (as they should be doing!)
json matches an md5 hash. This was causing flaky tests because the
order of the users in the test doing `curl -s localhost:9200/_xpack/security/user -u
es_admin:changeMeAgain` is not consistent which caused random failures.
Now if it does fail we will actually know the reason why:
```
security users
should have the elastic user
should have the kibana user (FAILED - 1)
should have the kibana_server user
should have the logstash user
logstash_system access check
should be reported as version 6.2.4
Failures:
1) Xpack Tests security users should have the kibana user
Failure/Error: expect(result['kibana']['username']).to eq('kibana4')
expected: "kibana4"
got: "kibana"
```
The failure output use to look like:
```
Failures:
1) Xpack Tests Command "curl -s localhost:9200/_xpack/security/user -u es_admin:changeMeAgain | md5sum | grep b6a1293c343e745a508c74778c9be8bb" exit_status should eq 0
Failure/Error: its(:exit_status) { should eq 0 }
expected: 0
got: 1
(compared using ==)
/bin/sh -c curl\ -s\ localhost:9200/_xpack/security/user\ -u\ es_admin:changeMeAgain\ \|\ md5sum\ \|\ grep\ b6a1293c343e745a508c74778c9be8bb
```
