Added support for UC external locations (direct mode only)#4484
Added support for UC external locations (direct mode only)#4484andrewnester wants to merge 9 commits intomainfrom
Conversation
|
Commit: 0fd9a36
30 interesting tests: 12 flaky, 7 KNOWN, 5 SKIP, 5 RECOVERED, 1 FAIL
Top 50 slowest tests (at least 2 minutes):
|
denik
left a comment
There was a problem hiding this comment.
Can you add config for invariant tests in acceptance/bundle/invariant?
| - field: storage_root | ||
| reason: immutable | ||
|
|
||
| external_locations: |
There was a problem hiding this comment.
question - were you able to run 'make generate-direct' to update resources.generated.yml
There was a problem hiding this comment.
nope, it failed actually with
Traceback (most recent call last):
File "/Users/andrew.nester/cli/bundle/direct/tools/generate_resources.py", line 12, in <module>
import yaml
ModuleNotFoundError: No module named 'yaml'
which seems to be unrelated
| "custom_tags": | ||
| "description": |- | ||
| PLACEHOLDER | ||
| github.com/databricks/databricks-sdk-go/service/catalog.AwsSqsQueue: |
There was a problem hiding this comment.
These descriptions should automatically be generated during the next CLI bump. Worth keeping an eye on because those descriptions will auto-generate our public documentation.
shreyas-goenka
left a comment
There was a problem hiding this comment.
Thanks, lgtm except one concern. Can you please TAL whether we can get test coverage for this on some cloud as well. Otherwise this can be fragile.
| } | ||
|
|
||
| func (e *ExternalLocation) GetURL() string { | ||
| // Return empty as external locations don't have a workspace URL |
There was a problem hiding this comment.
optional: Can we still return the revelant s3 URL? Or any UI equivalent we have for the resource. This provides a nice experience when running bundle summary.
| Local = true | ||
| # External locations require actual storage credentials with cloud IAM setup | ||
| # which are environment-specific, so we only test locally with the mock server | ||
| Cloud = false |
There was a problem hiding this comment.
Should we atleast run these tests on one cloud? Like just AWS maybe?
| # which are environment-specific, so we only test locally with the mock server | ||
| Cloud = false | ||
| RecordRequests = false | ||
| RequiresUnityCatalog = true |
There was a problem hiding this comment.
optional: You can also set RunsOnDbr = true no to run these tests on DBR. It's opt-in for now.
Changes
Added support for UC external locations (direct mode only)
Why
This is a natural extension of support for UC catalogs where UC catalogs can have references to UC external locations.
Tests
Added an acceptance test