Renan — DevOps & Cloud freelancer in Porto Alegre

A cloud-native PCI compliant payment platform built on top of Azure. I was the main data platform architect. I defined the technologies and developed frameworks, libraries, and tools used by other data engineers. The data platform allows the ingestion of data using CDC on top of MongoDB, events from Kafka, and any file. It also allows processing data through streaming or batch processing with Spark running on Databricks or Kubernetes. The implementation of these frameworks and libraries empowered product data engineers to prioritize business requirements, resulting in a remarkable reduction of over 70% in the time required to onboard new data sources.