Skip to content

Commit 9a14b08

Browse files
jilu1jilu1
authored
Merge pull request #752 from magento/MQE-2206
Mqe 2206
2 parents d839076 + fd95a2a commit 9a14b08

File tree

4 files changed

+68
-104
lines changed

4 files changed

+68
-104
lines changed

‎CHANGELOG.md‎

Lines changed: 64 additions & 99 deletions
Original file line numberDiff line numberDiff line change
@@ -1,137 +1,102 @@
11
Magento Functional Testing Framework Changelog
22
================================================
3-
3.0.0 RC5
4-
---------
5-
6-
### Enhancements
7-
8-
* Readability
9-
* Removed blacklist/whitelist terminology in MFTF.
10-
11-
### Fixes
12-
13-
* Fixed javascript error seen on chrome 81 for dragAndDrop action.
14-
* Fixed allure issue when `WebDriverCurlException` is encountered in `afterStep`.
15-
16-
3.0.0 RC4
3+
3.0.0
174
---------
185

196
### Enhancements
207

218
* Customizability
9+
* Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.[See custom-helpers page for details](./docs/custom-helpers.md)
10+
* Removed deprecated actions `<executeSelenium>` and `<performOn>`.
2211
* `<group value="skip"/>` no longer skips a test. Instead, the test is added to the `skip` group.
23-
* Maintainability
24-
* `mftf.log` no longer includes notices and warnings at test execution time.
25-
* Added the Chrome option `--ignore-certificate-errors` to `functional.suite.dist.yml`.
26-
* Traceability
27-
* Changed the `bin/mftf static-checks` error file directory from the current working directory to `TESTS_BP/tests/_output/static-results/`.
28-
* Readability
29-
* Documented [3.0.0 Backward Incompatible Changes.](./docs/backward-incompatible-changes.md)
30-
31-
### Fixes
32-
33-
* Fixed issue where an extended data entity would not merge array items. Array items should merge properly now.
34-
* Fixed issue where Chrome remains running after MFTF suite finishes.
35-
36-
3.0.0 RC3
37-
---------
38-
39-
### Enhancements
40-
41-
* Maintainability
42-
* Added support for Two-Factor Authentication (2FA). [See configure-2fa page for details](./docs/configure-2fa.md)
43-
* Added new static check `annotationsCheck` that checks and reports missing annotations in tests.
44-
* Updated `bin/mftf static-checks` command to allow executing static-checks defined in `staticRuleSet.json` by default. [See command page for details](./docs/commands/mftf.md#static-checks)
45-
* Added new upgrade script to remove unused arguments from action groups.
46-
* Added unhandledPromptBehavior driver capability for Chrome 75+ support.
47-
* Removed redundant and unused classes.
48-
49-
### Fixes
50-
51-
* Fixed issue with custom helper usage in suites.
52-
* Fixed issue with decryption of secrets during data entity creation.
53-
* Fixed issue with merging of `array` items in data entity.
54-
55-
3.0.0 RC2
56-
---------
57-
58-
### Enhancements
59-
60-
* Maintainability
61-
* Added support for PHP 7.4.
62-
* Removed support for PHP 7.2.
63-
* Added support for PHPUnit 9.
64-
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
65-
* Added new actions: `assertEqualsWithDelta`, `assertNotEqualsWithDelta`, `assertEqualsCanonicalizing`, `assertNotEqualsCanonicalizing`, `assertEqualsIgnoringCase`, `assertNotEqualsIgnoringCase`.
66-
* Added new actions: `assertStringContainsString`, `assertStringNotContainsString`, `assertStringContainsStringIgnoringCase`, `assertStringNotContainsStringIgnoringCase` for string haystacks.
67-
* Removed actions: `assertInternalType`, `assertNotInternalType`, `assertArraySubset`.
68-
* Removed delta option from `assertEquals` and `assertNotEquals`.
69-
* Removed action `pauseExecution` and added `pause`. [See actions page for details](./docs/test/actions.md#pause)
70-
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
71-
* Added new static check that checks and reports references to deprecated test entities.
72-
* Bumped dependencies to support PHP/PHPUnit upgrade.
73-
74-
* Traceability
75-
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
7612

77-
### Fixes
78-
79-
* Fixed issue of resolving arguments of type `entity` in action groups within a custom helper.
80-
* Fixed reporting issue in output file for `testDependencies` static check.
81-
* Fixed a bug in `actionGroupArguments` static check when action group filename is missing `ActionGroup`.
82-
* Fixed issue of running suites under root `_suite` directory in Standalone MFTF.
83-
84-
### GitHub Issues/Pull Requests
85-
86-
* [#567](https://github.com/magento/magento2-functional-testing-framework/pull/567) -- log attachments for failed requests.
87-
88-
3.0.0 RC1
89-
---------
90-
91-
### Enhancements
92-
93-
* Customizability
94-
* Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.
95-
* Removed deprecated actions `<executeSelenium>` and `<performOn>`.
9613
* Maintainability
14+
* Added support for PHP 7.4.
15+
* Added support for PHPUnit 9.
16+
* Dropped support for PHP 7.0, 7.1, 7.2.
9717
* Schema updates for test entities to only allow single entity per file except Data and Metadata.
9818
* Support for sub-folders in test modules.
9919
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
100-
* Removed support for PHP 7.0 and 7.1.
10120
* Removed file attribute for `<module>` in suiteSchema.
21+
* Removed action `pauseExecution` and added `pause`. [See actions page for details](./docs/test/actions.md#pause)
22+
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
23+
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
24+
* Added new actions: `assertEqualsWithDelta`, `assertNotEqualsWithDelta`, `assertEqualsCanonicalizing`, `assertNotEqualsCanonicalizing`, `assertEqualsIgnoringCase`, `assertNotEqualsIgnoringCase`.
25+
* Added new actions: `assertStringContainsString`, `assertStringNotContainsString`, `assertStringContainsStringIgnoringCase`, `assertStringNotContainsStringIgnoringCase` for string haystacks.
26+
* Removed actions: `assertInternalType`, `assertNotInternalType`, `assertArraySubset`.
27+
* Removed delta option from `assertEquals` and `assertNotEquals`.
28+
* Added static check `deprecatedEntityUsage` that checks and reports references to deprecated test entities.
29+
* Added static check `annotations` that checks and reports missing annotations in tests.
30+
* Updated `bin/mftf static-checks` command to allow executing static-checks defined in `staticRuleSet.json` by default. [See command page for details](./docs/commands/mftf.md#static-checks)
31+
* Added support for Two-Factor Authentication (2FA). [See configure-2fa page for details](./docs/configure-2fa.md)
32+
* Added new upgrade script to remove unused arguments from action groups.
33+
* `mftf.log` no longer includes notices and warnings at test execution time.
34+
* Added unhandledPromptBehavior driver capability for Chrome 75+ support.
35+
* Added the Chrome option `--ignore-certificate-errors` to `functional.suite.dist.yml`.
36+
10237
* Traceability
103-
* Removed `--debug` option NONE to disallow ability to turn off schema validation.
38+
* Removed `--debug` option `NONE` to disallow ability to turn off schema validation.
10439
* Notices added for test entity naming convention violations.
10540
* Metadata file names changed to `*Meta.xml`.
41+
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
42+
* Changed the `bin/mftf static-checks` error file directory from the current working directory to `TESTS_BP/tests/_output/static-results/`.
43+
10644
* Readability
107-
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md)
45+
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
46+
* Documented [3.0.0 Backward Incompatible Changes](./docs/backward-incompatible-changes.md).
47+
* Removed blacklist/whitelist terminology in MFTF.
48+
10849
* Upgrade scripts added to upgrade tests to MFTF major version requirements. See upgrade instructions below.
109-
* Bumped dependencies to latest possible versions.
110-
111-
### Fixes
112-
113-
* Throw exception during generation when leaving out .url for `amOnPage`.
114-
* `request_timeout` and `connection_timeout` added to functional.suite.yml.dist.
115-
* Fixed `ModuleResolver` to resolve test modules moved out of deprecated path.
50+
* Bumped dependencies to support PHP/PHPUnit upgrade.
11651

11752
### Upgrade Instructions
11853

11954
* Run `bin/mftf reset --hard` to remove old generated configurations.
12055
* Run `bin/mftf build:project` to generate new configurations.
12156
* Run `bin/mftf upgrade:tests`. [See command page for details](./docs/commands/mftf.md#upgradetests).
12257
* After running the above command, some tests may need manually updates:
123-
* Remove all occurrences of `<executeInSelenium>` and `<performOn>`
124-
* Remove all occurrences of `<module file=""/>` from any `<suite>`s
58+
* Remove all occurrences of `<executeInSelenium>` and `<performOn>`.
59+
* Remove all occurrences of `<module file=""/>` from any `<suite>`s.
12560
* Ensure all `<assert*>` actions in your tests have a valid schema.
12661
* Lastly, try to generate all tests. Tests should all be generated as a result of the upgrades.
12762
* If not, the most likely issue will be a changed XML schema. Check error messaging and search your codebase for the attributes listed.
12863

129-
2.6.3
64+
### Fixes
65+
66+
* Throw exception during generation when leaving out .url for `amOnPage`.
67+
* `request_timeout` and `connection_timeout` added to functional.suite.yml.dist.
68+
* Fixed `ModuleResolver` to resolve test modules moved out of deprecated path.
69+
* Fixed issue of resolving arguments of type `entity` in action groups within a custom helper.
70+
* Fixed reporting issue in output file for `testDependencies` static check.
71+
* Fixed a bug in `actionGroupArguments` static check when action group filename is missing `ActionGroup`.
72+
* Fixed issue of running suites under root `_suite` directory in Standalone MFTF.
73+
* Fixed issue with custom helper usage in suites.
74+
* Fixed issue with decryption of secrets during data entity creation.
75+
* Fixed issue with merging of `array` items in data entity.
76+
* Fixed issue where an extended data entity would not merge array items. Array items should merge properly now.
77+
* Fixed issue where Chrome remains running after MFTF suite finishes.
78+
* Fixed javascript error seen on Chrome 83 for dragAndDrop action.
79+
* Fixed allure issue when `WebDriverCurlException` is encountered in `afterStep`.
80+
81+
### GitHub Issues/Pull Requests
82+
83+
* [#567](https://github.com/magento/magento2-functional-testing-framework/pull/567) -- log attachments for failed requests.
84+
85+
### Demo Video links
86+
87+
* [MFTF 3.0.0 RC1](https://www.youtube.com/watch?v=z0ZaZCmnw-A&t=2s)
88+
* [MFTF 3.0.0 RC2](https://www.youtube.com/watch?v=BJOQAw6dX5o)
89+
* [MFTF 3.0.0 RC3](https://www.youtube.com/watch?v=scLb7pi8pR0)
90+
91+
2.6.4
13092
-----
13193

13294
### Fixes
13395
* added dependency to packages MFTF used but never specified in composer.json
13496

97+
2.6.3
98+
-----
99+
135100
### New Feature
136101
* `--filter` option was added to `bin/mftf generate:tests` command. For more details please go to https://devdocs.magento.com/mftf/docs/commands/mftf.html#generatetests
137102

‎bin/mftf‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ try {
3131
$version = $version['version'];
3232
$application = new Symfony\Component\Console\Application();
3333
$application->setName('Magento Functional Testing Framework CLI');
34-
$application->setVersion('3.0.0');
34+
$application->setVersion($version);
3535
/** @var \Magento\FunctionalTestingFramework\Console\CommandListInterface $commandList */
3636
$commandList = new \Magento\FunctionalTestingFramework\Console\CommandList;
3737
foreach ($commandList->getCommands() as $command) {

‎composer.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"name": "magento/magento2-functional-testing-framework",
33
"description": "Magento2 Functional Testing Framework",
44
"type": "library",
5-
"version": "3.0.0-RC5",
5+
"version": "3.0.0",
66
"license": "AGPL-3.0",
77
"keywords": ["magento", "automation", "functional", "testing"],
88
"config": {

‎composer.lock‎

Lines changed: 2 additions & 3 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)