Remove Null and empty values from json sink to blob storage

I am using Azure dataflow to read records from Azure SQL DB as source, modify it and write to blob storage as json file. I need only non-empty and -null values in JSON.

So, if source record is as below:

CustomerID, contact, age  10000, null, 45  10001, "", 35  10002, "7805289894", 38  

JSON should be like:

[{"CustomerID": 10000, "age": 45}, {"CustomerID": 10001, "age": 35}, {"CustomerID": 10002, "contact": "7805289894", "age": 38}]  

How can we achieve this in azure dataflow?

Please help solve this issue.

https://stackoverflow.com/questions/66139032/remove-null-and-empty-values-from-json-sink-to-blob-storage February 10, 2021 at 10:39PM