2021年3月21日星期日

Azure Blob Storage downloading ORC files in Python

It is my first time using Azure Storage and ORC.

Here is what I have learned so far, I able to download a ORC blob storage file from Azure and save to disk. Once download complete, I can iterate ORC file using pyorc library in Python. They are mostly smaller files and can easily fit into memory. My question is, instead of writing to a file, I would like to keep the blob in memory and iterate and can avoid writing to a disk. I can download the blob into stream but I am not sure how to use pyorc with blob stream or I cannot locate the help for it.

I appreciate any help and best practice for azure storage download.

https://stackoverflow.com/questions/66724177/azure-blob-storage-downloading-orc-files-in-python March 21, 2021 at 12:52AM

没有评论:

发表评论