I’m a Software Engineer who loves code, design and writing. In this blog you can find my latest work that I found intersting.
Writing Parquets to Azure (Blob Storage / Data Lake Gen2 Storage)
Writing parquets with Azure with Java In this guide I will show you how to write parquet files from a vanilla java code. In order to do that we will work with AvroParquertWriter<GenericRecord> and with Path and Configuration from the hdfs libraries. Why Java? It is very common when working with parquets to work with Apache Spark, But in many data flow architectures we don’t want to use Spark for microservices, for example, a service which parse small chunks of data and saves them to blob storage....
Reactor-Netty Quickstart Guide
Do i really need reactor netty? Reactor creators state in their website about reactor that reactor is "Well-suited for a microservices architecture, Reactor offers backpressure-ready network engines for HTTP (including Websockets), TCP, and UDP." And the answer to your question is the annoying answer, it depends. In general, reactor netty is a framework that will let you “squeeze” the most from your resources with its main feature Non-Blocking IO, but we will get to it soon....