ADLSFileIO: support access token authentication via the new adls.token property
#13825
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes #13818
This PR adds support for passing Microsoft Entra access token to
ADLSFileIOusing the newly addedADLS_TOKENproperty. The access token is used to create a TokenCredential class used to configure the DataLakeFileSystemClientBuilder.See a similar implementation in apache doris
The token expiration is set for 1 hour for now, which is the default lifetime of an access token. We can make this configurable in the future.
Testing
Built and tested locally with spark
Pass in token string