QuickFIX/J and Kafka with Avro

For now I use simple conversion from FIX message to JSON

(https://github.com/apache/camel/blob/master/components/camel-quickfix/src/test/java/org/apache/camel/component/quickfixj/examples/transform/QuickfixjMessageJsonTransformer.java)

as String type and push it into Kafka broker using default Kafka serializer (probably String serializer).

Now, I would like like to use Avro as Schema Serializer for FIX messages. As we know, there are a lot of versions and tags. My JSON also changing dynamically because sometimes some attributes are present sometimes are absent.

In that case, How could I define the Avro schema? I would also like to point out that there are many different versions of the FIX protocol.

Thanks a lot for help, I am new in QuickFix and I decided to create this, maybe someone else will benefit from it.

https://stackoverflow.com/questions/66753020/quickfix-j-and-kafka-with-avro March 23, 2021 at 03:56AM