feat: add url support for blob

[wojiaodoubao]

The unit test test_blob_https_url_and_range_s3_roundtrip shows the case, it could be ran as below.

export LANCE_S3_ENDPOINT=https://{bucket}.{endpoint}
export LANCE_S3_BUCKET={bucket}
export AWS_REGION={region}
export AWS_ACCESS_KEY_ID={AK}
export AWS_SECRET_ACCESS_KEY={SK}

pytest python/tests/test_blob.py::test_blob_https_url_and_range_s3_roundtrip

[codecov]

Codecov Report

❌ Patch coverage is 69.50000% with 61 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
rust/lance-io/src/object_store/object_url.rs	54.38%	24 Missing and 2 partials ⚠️
rust/lance-io/src/object_store/providers/aws.rs	55.55%	10 Missing and 6 partials ⚠️
rust/lance/src/dataset/blob.rs	81.48%	2 Missing and 8 partials ⚠️
rust/lance-io/src/object_store.rs	85.71%	5 Missing and 2 partials ⚠️
rust/lance-io/src/object_store/providers/azure.rs	50.00%	0 Missing and 1 partial ⚠️
rust/lance-io/src/object_store/providers/gcp.rs	50.00%	0 Missing and 1 partial ⚠️

📢 Thoughts on this report? Let us know!

[majin1102]

Therefore, I propose we add URL-related functions to the Lance Blob API

Wondering if we surely introduce this URL-based approach to take a row or rows, should we limit this to fields that use Blob API?

[wojiaodoubao]

Wondering if we surely introduce this URL-based approach to take a row or rows, should we limit this to fields that use Blob API?

I think we should only allow blob api to get URLs, which is the BlobFile.

[Xuanwo]

opendal has a native http service support, maybe we can just use that