ERROR: PXF server error : org.apache.hadoop.fs.azure.AzureException: No credentials found for account ACCOUNT.blob.core.windows.net in the configuration
Article ID: 377547
Updated On:
Products
Issue/Introduction
When trying to read data from Azure Blob Storage.
This may apply to other external storage accessed via Platform Extension Framework (PXF)
The PXF logs, for Azure blob storage, reported:
2024-09-12 23:19:22.491 EDT ERROR [1726162477-0000013929:Azure1:4 ] 146471 --- [response-1] o.g.p.s.c.PxfErrorReporter : org.apache.hadoop.fs.azure.AzureException: No credentials found for account ACCOUNT_NAME.blob.core.windows.net in the configuration, and its container CONTAINER_NAME is not accessible using anonymous credentials. Please check if the container exists first. If it is not publicly available, you have to provide account credentials.
org.apache.hadoop.fs.azure.AzureException: org.apache.hadoop.fs.azure.AzureException: No credentials found for account deltalkedheastusdev.blob.core.windows.net in the configuration, and its container pxf-poc is not accessible using anonymous credentials. Please check if the container exists first. If it is not publicly available, you have to provide account credentials.
at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.createAzureStorageSession(AzureNativeFileSystemStore.java:1094) ~[hadoop-azure-2.10.2.jar!/:?]
at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.initialize(AzureNativeFileSystemStore.java:544) ~[hadoop-azure-2.10.2.jar!/:?]
at org.apache.hadoop.fs.azure.NativeAzureFileSystem.initialize(NativeAzureFileSystem.java:1387) ~[hadoop-azure-2.10.2.jar!/:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3261) ~[hadoop-common-2.10.2.jar!/:?]
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:121) ~[hadoop-common-2.10.2.jar!/:?]
:
:
Cause
The PXF service will only read configuration files that match *-site.xml pattern from the SERVER directory.
That is it will read files that end in "-site.xm", for example:
core-site.xml
core_mytest-site.xml
wasbs-site.xml
wasbs_poc-site.xml
It will ignore files that do not end in '-site.xml', for example:
wasbs-site_poc.xml
core-site_test.xml
Resolution
Check the configuration files in the ${PXF_BASE}/servers/<SERVER_NAME>/ directory.
Ensure they match the pattern *-site.xml.
If any are incorrectly named, rename them with "mv" command.
Then sync the configuration with the segment servers with pxf cluster sync -d
Feedback
