1,573 questions with Azure Data Lake Storage tags

Sort by: Updated
1 answer One of the answers was accepted by the question author.

ADLS data incoporation with other data source

Hi friends, we have an ERP data in ADLS and we have come up with KPIs on that dataset, but business want KPIs that consist of ERP and legacy application data which has data since that legacy database host data since 1985 hence it want KPIs that enlist…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-08-26T15:24:44.77+00:00
azure_learner 755 Reputation points
accepted 2025-08-28T07:48:29.99+00:00
azure_learner 755 Reputation points
2 answers One of the answers was accepted by the question author.

Upgrade to a storage account with Azure Data Lake Gen2 capabilities is temporarily disabled

Hi, I would like to upgrade a Storage Account with Data Lake Gen2 capabilities (hierarchical namespace). When I'm trying to do it from Azure console UI, I'm getting the message: "Upgrade to a storage account with Azure Data Lake Gen2 capabilities is…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-08-25T08:17:14.0266667+00:00
Adrien Desprez 20 Reputation points
accepted 2025-08-26T12:41:14.2966667+00:00
Adrien Desprez 20 Reputation points
1 answer One of the answers was accepted by the question author.

ADLS structure approach

Hi friends, we are getting data from API endpoint , and saving the data in Parquet file format, since it is Parquet file format ,I have designed Data Lake  hierarchical order in the form ,ADLS hierarchy for landing zone,bronze, silver layer now, for…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-08-23T17:16:33.8166667+00:00
azure_learner 755 Reputation points
commented 2025-08-24T13:28:25.8866667+00:00
azure_learner 755 Reputation points
2 answers One of the answers was accepted by the question author.

How to change Blob Inventory files daily generation time

In my Azure Data Lake Storage Gen2 storage account, I have a Blob Inventory rule to generate files daily: I want the files to be generated at the end of the day (9PM), since I have another scheduled process that consumes the generated data at 10PM every…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-08-20T18:44:05.5666667+00:00
Nguyen, Tran 20 Reputation points
commented 2025-08-22T18:02:00.62+00:00
Priya ranjan Jena 265 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

[URGENT] Accidental Deletion of Azure Data Lake Storage Gen2 Account – Can Data Be Restored?

Hello Microsoft Support Team, I am reaching out regarding an accidental deletion of our Azure Data Lake Storage Gen2 account. The storage account was deployed inside the Resource Group rg-x-production, which I unintentionally deleted. After the deletion,…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-08-20T11:07:04.62+00:00
Thanh Nguyen 20 Reputation points
accepted 2025-08-20T19:44:02.6066667+00:00
Thanh Nguyen 20 Reputation points
2 answers

Exporting D365 F&O Data Directly to Azure Data Lake Gen2 Without Dataverse. Questions on Current Approach, Format & Folder Structure

Hi Everyone, I’m currently working on exporting all tables/entities from Dynamics 365 Finance and Operations (Tier 2 environment) directly to Azure Data Lake Gen2. I don’t want to use Dataverse in between. I’ve already created a Storage Account in Azure…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-29T07:42:22.92+00:00
Hafiz Hassan Mahmood Raja 0 Reputation points
commented 2025-08-20T09:26:03.2233333+00:00
Nandamuri Pranay Teja 4,855 Reputation points Microsoft External Staff Moderator
1 answer

Azure Storage account tier availability

Hi, We plan on using Lifecycle policies in Azure Storage Account (ADLS). I know there are different SLAs for tiers. The question is: if a blob is in cold tier and this tier is unavailable, can we move it to hot tier and the blob can be read again? Would…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-08-04T09:24:28.7833333+00:00
Artur Basinski 0 Reputation points
commented 2025-08-11T05:29:23.6133333+00:00
Pranitha Maddi 475 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

how to get SLA% of a storage account

we knew there a metric Availability showing the SLA% of a storage account (https://learn.microsoft.com/en-us/azure/azure-monitor/reference/supported-metrics/microsoft-storage-storageaccounts-metrics#category-transaction ), but this metric also contains…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-30T06:21:34.4133333+00:00
Gallatin 21V 266 Reputation points
accepted 2025-08-08T09:24:33.44+00:00
Gallatin 21V 266 Reputation points
0 answers

Connecting to Azure Data Lake Storage Gen2 from Tableau Desktop is throwing error

Error Receiving in Tableau Desktop: Tableau received an OAuth error from your request. Please see the error message for more information: User authorization failed (invalid_client). When checked the auth url it seems the url is the one like below -…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-01-31T21:06:38.6066667+00:00
Deep Saha 0 Reputation points
edited a comment 2025-08-07T07:56:41.85+00:00
VarunTha 14,865 Reputation points Microsoft External Staff Moderator
1 answer

401 Unauthorized "Audience validation failed" from ADLS endpoint

We are using service principal credentials to authenticate using OAuth2 token. Fetching the access token step is successful however, request getting failed when hitting ADLS endpoint . Error response : Exact error message :…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2024-05-03T11:11:59.4933333+00:00
Shubhank 0 Reputation points
commented 2025-07-28T10:24:18.03+00:00
Ganesh Patapati 9,005 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

How to enable Managed Identity for accessing an ADLS Gen2 storage?.

How to enable or use Managed Identity for an ADLS Gen2 storage, instead of using storage access keys.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-24T22:28:25.4766667+00:00
Amit Puthenpura (Wipro Ltd) 20 Reputation points Microsoft External Staff
accepted 2025-07-25T17:29:44.9833333+00:00
Amit Puthenpura (Wipro Ltd) 20 Reputation points Microsoft External Staff
1 answer One of the answers was accepted by the question author.

Transactional Data Vs Non Transactional Data : Partition Depth

Please can I have some perspective on storing Transactional Data in ADLS Gen2. I have read that we should store in Day wise partitions although the write operation could be slow but read operation could be faster. We have set of T and NT tables whose…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-18T16:31:29.71+00:00
Anand Deshpande 40 Reputation points
commented 2025-07-18T16:54:00.6966667+00:00
Nandamuri Pranay Teja 4,855 Reputation points Microsoft External Staff Moderator
1 answer

How to form Delta lake tables on top of Parquet files stored in ADLS GEN 2

Hi, Good day! I'm looking for some guidance on how do I create Delta Lake tables on top of Parquet files stored in ADLS Gen2. The constraint here is we don't have Databricks whitelisted by our organization policies. The ultimate goal is to perform CDC…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-11T05:54:47.9433333+00:00
Anand Deshpande 40 Reputation points
commented 2025-07-15T07:17:54.9033333+00:00
Nandamuri Pranay Teja 4,855 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Does synapse serverless sql pool OPENROWSET support "parquest based structured stream" format?

I can read from a data lake structured stream using synapse serverless sql pool OPENROWSET, by specifying FORMAT = 'SSTREAM'. Does OPENROWSET support "parquest based structured stream" format? If yes, then what value should I specify to FORMAT…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,432 questions
asked 2024-05-08T03:27:38.5+00:00
Salander He 66 Reputation points Microsoft Employee
answered 2025-07-09T19:01:00.0433333+00:00
Dipanjan Karmakar 0 Reputation points Microsoft Employee
1 answer

Service Principle cannot access ADLS

Could you help me debug Service Principle has been granted a Storage Blob Data Contributor on the storage account level. However, it cant access the container, 403 Request ID: 9f415b7e-601f-0018-16f1-eb704e000000

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-03T08:16:43.1866667+00:00
Christoper Wulur (ext) 0 Reputation points
commented 2025-07-07T02:42:46.46+00:00
Nandamuri Pranay Teja 4,855 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Dropped sftp file upload

A file was uploaded to our blob storage  via  sftp  by one of our vendors. Even though it showed the fle was sent it never made it to the xmlfiles container.See logs below. What could have been the cause? weekly inventory valuation Report for 06/28/2025…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-02T18:36:00.1666667+00:00
Moshi Musukwa 20 Reputation points
commented 2025-07-03T17:04:45.3466667+00:00
Moshi Musukwa 20 Reputation points
1 answer One of the answers was accepted by the question author.

Storage Approach Comparison in Azure ADLS Gen2

Hello, May someone please help me with valuable suggestion which approach I should Take. It would be great if share thoughts with Pros and Cons. Scenario 1 : Scenerio 2 : Scenerio 1 Details: 1.Silver layer stored in Azure SQL / Cosmos…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-07-02T16:54:29.0666667+00:00
Relay 300 Reputation points
accepted 2025-07-03T02:10:40.85+00:00
Relay 300 Reputation points
1 answer One of the answers was accepted by the question author.

GDPR Handling In ADLS Gen2

I am creating a Centralised Data LAKEHOUSE as shown in Diagram. I have created a Second ADLS Gen2 so it easily connect with Databricks. I am seeking your valuable help in designing ADLS Gen 2 for silver layer. Do This approach is good. Do I need to…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-06-18T13:43:02.8566667+00:00
Relay 300 Reputation points
accepted 2025-06-19T04:32:37.6966667+00:00
Relay 300 Reputation points
1 answer One of the answers was accepted by the question author.

Is it possible to create Lakehouse with case insensitive collation in Fabric?

Is it possible to make lakehouse SQL end point as case insensitive collation, Or is there way to create a lakehouse with  case insensitive collation like we create warehouse (https://learn.microsoft.com/en-us/fabric/data-warehouse/collation)

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-06-09T20:24:18.4133333+00:00
Venkateswarlu Pottapalli 40 Reputation points Microsoft External Staff
accepted 2025-06-09T23:08:53.4933333+00:00
Venkateswarlu Pottapalli 40 Reputation points Microsoft External Staff
1 answer One of the answers was accepted by the question author.

Folder and contents within an ADLS blob deleted, no records within logs

Between the hours of 3:00 PM CST on 6/4/2025 and 8:20 AM CST on 6/5/2025, a folder and it's contents were deleted from one of our storage containers. This folder is not within our deleted items (we have 7 day retention enabled), and I cannot locate any…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,573 questions
asked 2025-06-05T18:53:09.0166667+00:00
LanceKramer-6297 20 Reputation points
accepted 2025-06-09T14:55:49.67+00:00
LanceKramer-6297 20 Reputation points