Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion airflow-core/tests/system/example_empty.py
Original file line number Diff line number Diff line change
Expand Up @@ -44,5 +44,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
2 changes: 1 addition & 1 deletion contributing-docs/12_provider_distributions.rst
Original file line number Diff line number Diff line change
Expand Up @@ -297,7 +297,7 @@ You can see for example ``google`` provider which has very comprehensive documen
* `Documentation <../../providers/google/docs>`_
* `System tests/Example Dags <../providers/google/tests/system/google/>`_

Part of the documentation are example dags (placed in the ``tests/system`` folder). The reason why
Part of the documentation are example dags (placed in the ``providers/<provider>/tests/system`` folder). The reason why
they are in ``tests/system`` is because we are using the example dags for various purposes:

* showing real examples of how your provider classes (Operators/Sensors/Transfers) can be used
Expand Down
6 changes: 3 additions & 3 deletions contributing-docs/testing/system_tests.rst
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,7 @@ There are multiple ways of running system tests. Each system test is a self-cont
other Dag. Some tests may require access to external services, enabled APIs or specific permissions. Make sure to
prepare your environment correctly, depending on the system tests you want to run - some may require additional
configuration which should be documented by the relevant providers in their subdirectory
``tests/system/<provider_name>/README.md``.
``providers/<provider_name>/tests/system/<provider_name>/README.md``.

Running as Airflow Dags
.......................
Expand All @@ -125,8 +125,8 @@ your Airflow instance as Dags and they will be automatically triggered. If the s
how to set up the environment is documented in each provider's system tests directory. Make sure that all resource
required by the tests are also imported.

Running via Pytest + Breezee
............................
Running via Pytest + Breeze
...........................

Running system tests with pytest is the easiest with `Breeze <https://github.com/apache/airflow/blob/main/dev/breeze/doc/README.rst>`_.
Breeze makes sure that the environment is pre-configured, and all additional required services are started,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,5 +63,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -65,5 +65,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -63,5 +63,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -48,5 +48,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -50,5 +50,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -80,5 +80,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
2 changes: 1 addition & 1 deletion providers/amazon/tests/system/amazon/CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ will always be given. For example, I stole that line from @potiuk!
# Scope

This guide is meant to be used in addition to the [community system test design
guide](/tests/system/README.md) and only applies to system tests within the Amazon
guide](/contributing-docs/testing/system_tests.rst) and only applies to system tests within the Amazon
provider package, though other providers are welcome to adopt them as well. In any
cases of conflicting information or confusion, this document should take precedence
within the Amazon provider package.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -122,5 +122,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -212,5 +212,5 @@ def delete_flow(flow_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -193,5 +193,5 @@ def read_results_from_s3(bucket_name, query_execution_id):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -83,5 +83,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -302,5 +302,5 @@ def delete_job_queue(job_queue_name):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -253,5 +253,5 @@ def should_run_provision_throughput():

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -183,5 +183,5 @@ def stop_batch_inference(job_arn: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -603,5 +603,5 @@ def delete_opensearch_policies(collection_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -120,5 +120,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -145,5 +145,5 @@ def pii_entities_detection_job_workflow():

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -226,5 +226,5 @@ def create_kwargs_doctors_notes():

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -254,5 +254,5 @@ def delete_locations(locations):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
2 changes: 1 addition & 1 deletion providers/amazon/tests/system/amazon/aws/example_dms.py
Original file line number Diff line number Diff line change
Expand Up @@ -448,5 +448,5 @@ def delete_security_group(security_group_id: str, security_group_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -380,5 +380,5 @@ def delete_dms_assets(

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -136,5 +136,5 @@ def delete_table(table_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -269,5 +269,5 @@ def stop_execution():

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
2 changes: 1 addition & 1 deletion providers/amazon/tests/system/amazon/aws/example_ec2.py
Original file line number Diff line number Diff line change
Expand Up @@ -191,5 +191,5 @@ def parse_response(instance_ids: list):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
2 changes: 1 addition & 1 deletion providers/amazon/tests/system/amazon/aws/example_ecs.py
Original file line number Diff line number Diff line change
Expand Up @@ -238,5 +238,5 @@ def clean_logs(group_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -177,5 +177,5 @@ def delete_cluster(cluster_name: str) -> None:

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -154,5 +154,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -168,5 +168,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -210,5 +210,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -189,5 +189,5 @@ def delete_launch_template(template_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -241,5 +241,5 @@ def delete_launch_template(template_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
2 changes: 1 addition & 1 deletion providers/amazon/tests/system/amazon/aws/example_emr.py
Original file line number Diff line number Diff line change
Expand Up @@ -238,5 +238,5 @@ def get_step_id(step_ids: list):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -353,5 +353,5 @@ def delete_virtual_cluster(virtual_cluster_id):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -118,5 +118,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -166,5 +166,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -81,5 +81,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -83,5 +83,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -134,5 +134,5 @@ def upload_gcs_file(bucket_name: str, object_name: str, user_project: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -127,5 +127,5 @@ def delete_vault(vault_name):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
2 changes: 1 addition & 1 deletion providers/amazon/tests/system/amazon/aws/example_glue.py
Original file line number Diff line number Diff line change
Expand Up @@ -223,5 +223,5 @@ def glue_cleanup(crawler_name: str, job_name: str, db_name: str) -> None:

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -217,5 +217,5 @@ def delete_ruleset(ruleset_name):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -216,5 +216,5 @@ def delete_ruleset(ruleset_name):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -175,5 +175,5 @@ def delete_job(job_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -94,5 +94,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -214,5 +214,5 @@ def transform_video_ids(**kwargs):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -173,5 +173,5 @@ def configure_hive_connection(connection_id: str, hostname: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -142,5 +142,5 @@ def create_connection(conn_id_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -101,5 +101,5 @@

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -288,5 +288,5 @@ def delete_kinesis_stream(stream: str, region: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -148,5 +148,5 @@ def delete_lambda(function_name: str):

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Original file line number Diff line number Diff line change
Expand Up @@ -102,5 +102,5 @@ def delete_temp_file():

from tests_common.test_utils.system_tests import get_test_run # noqa: E402

# Needed to run the example DAG with pytest (see: tests/system/README.md#run_via_pytest)
# Needed to run the example DAG with pytest (see: contributing-docs/testing/system_tests.rst)
test_run = get_test_run(dag)
Loading
Loading