Monitorizacion de Azure Databricks a escala

Spanish Advanced DATA & AI

Si usas extensivamente Databricks sabrás del dolor de cabeza que supone afinar su coste, sobre todo cuando trabajas con jobs que crean clusters y tus devs pueden crear a su gusto lo que necesiten. En esta sesión veremos cómo podemos hacer monitorizacion de recursos consumidos por databricks de forma centralizada y a gran escala utilizando mucho menos de lo que crees y sin tener que llegar a montar el monstruo que es Databricks Overwatch. En esta sesión vamos a ver OMS-Agent, spark-monitoring, azure data factory, kusto, Azure Log analytics, SQL Server y si nos da tiempo…PowerBI!!. Prepárate que vienen curvas :)


Enrique Catalá Bañuls

Microsoft Data Platform MVP | Data & AI technical lead at @VerneGroup

Microsoft Data Platform MVP, Computer Engineer, Certified Kubernetes Administrator, Microsoft Certified Trainer. Working as Data & AI technical leader for @VerneGroup with focus on Data Platform scalability , performance and High availability environments.

Code of Conduct

We seek to provide a respectful, friendly, professional experience for everyone, regardless of gender, sexual orientation, physical appearance, disability, age, race or religion. We do not tolerate any behavior that is harassing or degrading to any individual, in any form. The Code of Conduct will be enforced.

Who does this Code of Conduct apply to?

All live stream organizers using the Global Azure brand and Global Azure speakers are responsible for knowing and abiding by these standards. Each speaker who wishes to submit through our Call for Presentations needs to read and accept the Code of Conduct. We encourage every organizer and attendee to assist in creating a welcoming and safe environment. Live stream organizers are required to inform and enforce the Code of Conduct if they accept community content to their stream.

Where can I get help?

If you are being harassed, notice that someone else is being harassed, or have any other concerns, report it. Please report any concerns, suspicious or disruptive activity or behavior directly to any of the live stream organizers, or directly to the Global Azure admins at All reports to the Global admin team will remain confidential.

Code of Conduct for local live streams

We expect local organizers to set up and enforce a Code of Conduct for all Global Azure live stream.

A good template can be found at, including internationalized versions at An excellent version of a Code of Conduct, not a template, is built by the DDD Europe conference at