Introducing the Alvin Airflow real-time integration — The Modern Data Stack What does modern mean to you? The data ecosystem has grown exponentially in the last years, and the Modern Data Stack has emerged, a collection of tools that help you work with your data and manipulate it in many ways. …

Thoughts and learnings from my personal journey — On August 9th I was recognized as a Google Developer Expert (GDE) on Google Cloud Platform (GCP) technologies with emphasis on Data Analysis. When I announced it some people reached out to me asking why and how I've achieved this, then I got inspired by how-i-joined-the-google-developers-experts-program, and I decided to…

Thoughts on a personal journey into the modern world of data governance and DataOps. — In April of 2021, I chose to leave a 10 year job at CI&T and join a nascent startup company as their first hire. …

Learn how to ingest SAP HANA metadata to Google Data Catalog and extend it with your user needs — Google Data Catalog has community-maintained tools like the open source connectors, to ingest metadata from different data sources:

Scripts and Terraform automation to help you ensure best practices in Google Data Catalog — Disclaimer: All opinions expressed are my own, and represent no one but myself… There’s extensive documentation on what IAM Roles are available for Google Data Catalog. …

Best practices on two approaches, with code samples! — Disclaimer: All opinions expressed are my own, and represent no one but myself…. They come from the experience of participating in the development of fully operational sample connectors, available at: GitHub. If you want to hear more about some of the Data Catalog connectors use cases, please check the official…

From design decisions to step by step execution learn how to ingest Apache Atlas metadata in Google Data Catalog doing full and incremental runs. — Disclaimer: All opinions expressed are my own, and represent no one but myself…. They come from the experience of participating in the development of fully operational sample connectors, available on: github. If you missed the latest post talking about how Apache Atlas and Data Catalog structure their metadata, please check…

Learn how your metadata is structured on both systems. — Disclaimer: All opinions expressed are my own, and represent no one but myself…. They come from the experience of participating in the development of fully operational sample connectors, available on: github. If you missed any of the latest posts on how to ingest metadata into Data Catalog, please check the…

How to Create Data Catalog tags by inspecting all your BigQuery data with Cloud Data Loss Prevention. — Do you know what kind of sensitive data your organization holds? Are you keeping track of every change applied across all your tables and columns? Are you confident to answer questions an auditor may have on data regulations?