Grow Your Skills and Earn Rewards! Mark your calendar: 16 March – 03 April, 2026 Join us for a three-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whet...
- 61156 Views
- 214 replies
- 38 kudos
3 weeks ago
Developers want to write code, not provision databases. Learn how to create and deploy apps directly on the Databricks Platform. Join us on May 5-7. In this webinar, code comes first. Watch experts from Databricks and Cursor demonstrate how to get ...
- 280 Views
- 1 replies
- 4 kudos
Thursday
We are back with instructor-led Databricks Learning Festivals for APAC & EMEA! Both Udemy and LinkedIn recognized Databricks as one of the top fastest growing skills for 2026 — Udemy's The 100 Fastest-Growing Global Skills for 2026 and LinkedIn's T...
- 1645 Views
- 4 replies
- 6 kudos
4 weeks ago
How do you talk with your data? We’d love to hear how you use Genie to enable business self-service, discover new insights, and make better and faster decisions from your data. If you have a Genie story, please share it via this link and receive a $...
- 492 Views
- 4 replies
- 6 kudos
Tuesday
At Databricks, some of the most exciting innovation happens when powerful technology meets real-world problems. That’s why we’re launching BrickTalks Industry Month: a special series of four sessions showcasing how organizations across major industri...
- 535 Views
- 2 replies
- 7 kudos
2 weeks ago
June 15–18, 2026 Register Now! Join thousands of data analytics and AI professionals at Data+ AI Summit 2026, the world’s largest conference for data, analytics and AI in San Francisco and virtually. Don’t miss early-bird pricing! Early-bird discoun...
- 3162 Views
- 2 replies
- 2 kudos
02-19-2026
Tired of email support tickets piling up while SLAs tick down? The Optimize Customer Email Support with LLMs Solution Accelerator transforms your support team from reactive support to a more proactive approach. What this solves: Businesses must meet ...
- 214 Views
- 3 replies
- 1 kudos
Wednesday
Things move quickly in the Community, and even a week brings in a lot to catch up on... Here’s your weekly snapshot of all things Community: Who’s Leading the Charge? Showing up, sharing knowledge, and keeping the Community active – here’s...
- 221 Views
- 2 replies
- 4 kudos
Wednesday
Community Activity
- 1840 Views
- 4 replies
- 6 kudos
Managed MCP Server for Visual Studio Code and GitHub Copilot?
Hi!I am starting to explore the new managed Model Context Protocol (MCP) server with GitHub Copilot. I have successfully configured it to use the DBSQL MCP Server that you currently find in AI/ML -> Agents -> MCP Servers. As also shown in this post i...
- 1840 Views
- 4 replies
- 6 kudos
Latest Reply
- 6 kudos
Hi excavator-matt, Thanks for the follow-up and glad to hear you got Option C (PAT-based) working with Copilot and VSCode, and that you have moved to Claude Code with the official skills. Regarding the issues with Options A and B: Option A (OAuth U2M...
- 6 kudos
- 87 Views
- 2 replies
- 0 kudos
Best practices for health monitoring
Status page: https://status.databricks.com/ REST API: https://docs.databricks.com/api/workspace/workspace/getstatus I'm trying to perform health monitoring using the above status page and API, but is this the best method? If the API returns an error ...
- 87 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @kohei-matsumura , You can subscribe to the status with different methods, including a Webhook. You should provide a URL of a service which will receive POST calls every time there is a new event. You can also subscribe through Email or Slack. Che...
- 0 kudos
- 280 Views
- 1 replies
- 4 kudos
Ending the Developer Struggle: The Future of Fast App Development - Virtual Event (May 5–7)
Developers want to write code, not provision databases. Learn how to create and deploy apps directly on the Databricks Platform. Join us on May 5-7. In this webinar, code comes first. Watch experts from Databricks and Cursor demonstrate how to get ...
- 280 Views
- 1 replies
- 4 kudos
Latest Reply
- 4 kudos
Yeah, exactly. things are changing quickly. Developers should spend more time building real apps and less time worrying about infrastructure setup. Bringing app development, governance, authentication, and serverless Postgres directly into the Databr...
- 4 kudos
- 492 Views
- 4 replies
- 7 kudos
Share your thoughts on Genie and receive a $50 gift card!
How do you talk with your data? We’d love to hear how you use Genie to enable business self-service, discover new insights, and make better and faster decisions from your data. If you have a Genie story, please share it via this link and receive a $...
- 492 Views
- 4 replies
- 7 kudos
Latest Reply
- 7 kudos
I work for Insurance client and load data using Medallion architecture and load data in Gold Layer. So many Business users now Using Genie and Performing Validations and How many policies are being loaded/Monthly premium and How many Active/Cancelled...
- 7 kudos
- 41 Views
- 0 replies
- 0 kudos
DABS and git branch
From DABS, you can pass a git branch. It is also a really useful best practice, as this way you define that only the given branch can be deployed to the target (e.g., main only to target prod, otherwise it will fail). #databricks https://databrickste...
- 41 Views
- 0 replies
- 0 kudos
- 204 Views
- 8 replies
- 2 kudos
OrderBy is not sorting the results
Hi,I am currently using Lakeflow SDP ,firstly I am creating 2 views and then joining them and creating materialized view and using order by in the materialized view create function , but the results are not sorted does order by not work on materializ...
- 204 Views
- 8 replies
- 2 kudos
Latest Reply
- 2 kudos
If you are interested in these kind of topics, Designing Data Intensive Applications by Martin Kleppmann is a really good read (2nd edition is availble since a while)!
- 2 kudos
- 67 Views
- 3 replies
- 0 kudos
Kill/Cancel a Notebook Cell Running Too Long on an All-purpose Cluster
Hi everyone, I’m facing an issue when running a notebook on a Databricks All-purpose cluster. Some of my cells/pipelines run for a very long time, and I want to automatically cancel/kill them when they exceed a certain time limit.I tried setting spar...
- 67 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
For the issue - Some of my cells/pipelines run for a very long time, and I want to automatically cancel/kill them when they exceed a certain time limit.You can use job notifications with Metric threshold (Duration Warning for notifications & Duration...
- 0 kudos
- 803 Views
- 3 replies
- 7 kudos
Databricks Multi-Table Transactions - Part 1
If you've ever worked on an insurance data warehouse, or really any warehouse where data arrives from different systems at different times, you know the pain of keeping things in sync. I spent years building data warehouses for a property and casual...
- 803 Views
- 3 replies
- 7 kudos
- 53 Views
- 0 replies
- 0 kudos
Databricks Multi-Table Transactions - Part 2
In Part 1, we covered why multi-table transactions matter. Now let's build one. We'll create the tables from the claim wrap-up scenario, load sample P&C insurance data, and walk through what happens when the wrap-up succeeds, when it fails, and when...
- 53 Views
- 0 replies
- 0 kudos
- 261 Views
- 4 replies
- 4 kudos
Who All Are Attending Data + AI Summit 2026 in San Francisco?
I am excited to share that I have completed my registration for Data + AI Summit this year, happening from June 15 to June 18 in San Francisco. I am attending, and I wanted to check who else from our Databricks Community is planning to be there.For m...
- 261 Views
- 4 replies
- 4 kudos
Latest Reply
- 4 kudos
Absolutely @edonaire , even joining online is still a great way to learn and stay updated with all the latest announcements and ideas. I agree, the in-person networking has its own value, but the learning opportunity is still huge. Hoping we get more...
- 4 kudos
- 83 Views
- 2 replies
- 0 kudos
Rename Column Name of Streaming Table in Lakeflow Spark Declarative Pipeline
Hi, I would like to know if it is possible to rename the name of a column of a streaming table defined in Lakeflow Spark Declarative Pipeline without having to run a Full Refresh. Could u give me any ideas on how I can achieve this?
- 83 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
You canUpdate pipeline code to rename old column & trigger a Incremental Update (old_column and new_column exists after it)Old data will have NULL for new_column after Incremental Update. Update the table to fill new_column for such cases from old_co...
- 0 kudos
- 173 Views
- 3 replies
- 1 kudos
Resolved! Unable to Access Azure Blob Storage from Databricks Community Edition Notebook
Hi everyone,I’m currently using the Databricks Community Edition and trying to access data stored in Azure Blob Storage from my .ipynb notebook. The storage account is part of my student free Azure subscription.However, I’m not able to establish a co...
- 173 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi, I think you are referring to Databricks Free edition, in which case this doesn't support the connection to external storage such as Azure Blob storage. Thanks,Emma
- 1 kudos
- 16272 Views
- 3 replies
- 8 kudos
Materials to pass Databricks Data Engineering Associate Exam
Hi Guys, I have passed it already some time ago, but just recently have summarized all the materials which helped me to do it. Pay special attention to GitHub repository, which contains many great exercises prepared by Databricks teamhttps://youtu.be...
- 16272 Views
- 3 replies
- 8 kudos
Latest Reply
- 8 kudos
Cleared Databricks Data Engineering Associate recently. Practising real questions helped me a lot, and (Certs Topic) was a reliable resource.
- 8 kudos
- 214 Views
- 3 replies
- 1 kudos
Solution Accelerator Series | Optimize Customer Email Support With LLMs
Tired of email support tickets piling up while SLAs tick down? The Optimize Customer Email Support with LLMs Solution Accelerator transforms your support team from reactive support to a more proactive approach. What this solves: Businesses must meet ...
- 214 Views
- 3 replies
- 1 kudos
- 91 Views
- 1 replies
- 2 kudos
Solving Multi-Dimension Analytics in Databricks Dashboards with Views and Metric Views
If you've ever built a dashboard where you needed to track the same data across two different date dimensions, you know the frustration. You get the first chart working. You add the second. Then you realise cross-filtering just stopped working. I re...
- 91 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Thanks for sharing great example with detailed explanation.
- 2 kudos
Announcements
| User | Count |
|---|---|
| 2240 | |
| 1200 | |
| 1186 | |
| 1154 | |
| 955 |
| User | Count |
|---|---|
| 407 | |
| 286 | |
| 220 | |
| 63 | |
| 45 |
Latest from our Blog
SDP “How-To” Series. Part 2: How to Master Streaming Tables and Materialized Views
How to: Master Streaming Tables and Materialized Views Make sure to check out the previous post: https://community.databricks.com/t5/technical-blog/spark-declarative-pipelines-how-to-series-part-1-how...
Auto Loader with File Events - Simplified File Discovery at Scale
Summary Learn how Auto Loader with file events simplifies cloud storage ingestion by eliminating the need to choose between directory listing simplicity and classic notifications performance.Discover...
Databricks Platform Observability AI BI Dashboard
Overview Why Platform Administration & Observability Matter As data platforms scale, cost and complexity also scale along with them.Platform teams today are expected to: Control cloud spendEnable team...
[PARTNER BLOG] Unifying Enterprise Data with Lakehouse Federation
Focusing on the CoreUnderstanding Lakehouse FederationWhat is Query Federation?The Case for Query Federation: Why It MattersChoosing Your Path: Query Federation vs.LakeflowConnectEcosystem Compatibili...
