Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 272 Views
- 0 replies
- 0 kudos
Monday
DATABRICKS Asia-Pacific Learning Festival Free, virtual, hands-on Databricks training 21 & 22 October 2026 Virtual, labs included Free Ready to level up your Databricks skills? The Databricks Asia-Pacific Learning Festival is back, and ...
- 1772 Views
- 1 replies
- 1 kudos
2 weeks ago
FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 1835 Views
- 3 replies
- 6 kudos
3 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 2476 Views
- 0 replies
- 3 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 773 Views
- 0 replies
- 0 kudos
a week ago
Community Champion • September 2026 Meet Venugopal Dabbara Every month, our Community Champion Program recognizes a member who makes the Databricks Community better for everyone, through their knowledge, their willingness to help, and their commitmen...
- 622 Views
- 3 replies
- 6 kudos
2 weeks ago
Genome-wide association studies help identify genetic variations associated with a disease or trait. The Genome-Wide Association Studies Solution Accelerator builds on Glow, an open source project for genomic analysis, to provide a fast, scalable and...
- 140 Views
- 0 replies
- 1 kudos
Tuesday
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 164 Views
- 0 replies
- 3 kudos
Thursday
Community Activity
- 83 Views
- 1 replies
- 0 kudos
About Azure SQL Managed Connector
Hi Community,We are trying to configure a Databricks Lakeflow Connect managed SQL Server connector to ingest data from Azure SQL Database into Databricks.We are using a contained SQL database user that has access only to the specific source database,...
- 83 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hey,Unfortunately I have no experience with the said issue, but could federated queries be an option? Though, its also a possibility that you would face the same authentication issue with them.Basically you wouldn't ingest the data into Databricks fi...
- 0 kudos
- 88 Views
- 3 replies
- 1 kudos
External location Manage permission
Hi team, I'm trying to update the owner of an external location and I see the following message:Requires permission MANAGE on external location 'location_name'The owner of the resource, the user that created it doesn't have that permission? How is th...
- 88 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
The owner of an external location does have the MANAGE permission automatically. It just never shows up in the list of grants, because ownership already implies it. So the error isn’t about the owner. It’s about you, the person trying to change the o...
- 1 kudos
- 26 Views
- 0 replies
- 0 kudos
How New Developers Learn Databricks Genie: A Practical Learning Path
If you are new to the Databricks ecosystem, you have probably heard the name Genie in a demo, a keynote, or a hallway conversation. The pitch is simple and a little magical: ask a question about your data in plain English, and get back a table, a cha...
- 26 Views
- 0 replies
- 0 kudos
- 79 Views
- 1 replies
- 0 kudos
PIM for Groups with Databricks: users appear in group without activating, nothing shows in PIM to ac
Hi everyone,We’re setting up just-in-time read access to a Unity Catalog catalog for a small audit team using Microsoft Entra PIM for Groups, and I’d like to check whether our setup is right.SetupAzure Databricks with account-level SCIM provisioning ...
- 79 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
yeah if they show as members in the databricks account group that usually means they ended up as active or direct members in entra, not just eligible in pim, so the grants are probably live now. scim only syncs actual membership, it doesnt understand...
- 0 kudos
- 117 Views
- 3 replies
- 2 kudos
Databricks Connect + AutoDependencies + UDF + Streaming breaks
I have this toy python script:CATALOG = 'mpt_usd_gbl_bronze_dev' # <-- replaceSCHEMA = 'mpt_gbl_tco_fof' # <-- replacesrc=f'{CATALOG}.{SCHEMA}.toy_source'DEST = f'{CATALOG}.{SCHEMA}.toy_dest'from databricks.connect import DatabricksSession, Databrick...
- 117 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Thanks for the reply and apologies for the typos in the snippet! I tried to get withDependencies() to work but as my UDF was requiring an external package, it was still failing. It can be replicated with the following snippet:CATALOG = 'catalog' # <-...
- 2 kudos
- 33 Views
- 0 replies
- 0 kudos
See Databricks costs right where you work
What if you could see the cost of your Databricks resources without switching to a dashboard or digging through billing tables?We built FinOpsWay, a free browser extension that brings cost information directly into the Databricks interface.You can se...
- 33 Views
- 0 replies
- 0 kudos
- 29 Views
- 0 replies
- 0 kudos
How track of all Databricks badges and certifications
There are now 292 Databricks badges and certifications. I wanted to see which ones I’ve already earned and which ones are still available, but navigating the full list was becoming a bit of a pain.So I built a Credentials section on Bricksters to mak...
- 29 Views
- 0 replies
- 0 kudos
- 7639 Views
- 3 replies
- 7 kudos
How to Evaluate Delta Table Operational Health Using Delta Table History
In today’s world, data is everything. It drives decisions, powers automation, and fuels innovation. But with all this power comes a challenge: ensuring that the data we rely on remains accurate, trustworthy, and, most importantly, healthy. As organi...
- 7639 Views
- 3 replies
- 7 kudos
Latest Reply
- 7 kudos
Just as data quality depends on reliable monitoring and thoughtful analysis, personal well-being benefits from the right kind of support. Counseling in Chicago works best when you click with your therapist. You get matched thoughtfully, so sessions f...
- 7 kudos
- 108 Views
- 3 replies
- 3 kudos
Resolved! Zerobus rescue (VARIANT) not working. No Preview Available.
Has anyone tried using the rescue feature for json in zerobus-ingest? It seems like a very significant feature, assuming the schema incoming json is even 1% outside the control of team that may be ingesting on the databricks side. There needs to be ...
- 108 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
You’re reading the intended behavior correctly. Zerobus should route non-conforming fields into the rescue column instead of rejecting the record. Your error suggests the feature isn’t active on that table. Per the docs, if no column qualifies, the f...
- 3 kudos
- 509 Views
- 11 replies
- 9 kudos
Resolved! Zerobus Ingest with Kafka compliant API and WITHOUT a callback
Is see that kafka for zerobus is still in beta. So maybe something will change. Can someone tell me whether they are aware of an authentication handshake with this API that might AVOID the callback?Here is the python example, which uses a sophistica...
- 509 Views
- 11 replies
- 9 kudos
Latest Reply
- 9 kudos
I don’t see a way to skip the callback inside the Kafka API itself, but there are workarounds.What the docs say (page updated Oct 1, 2026):OAUTHBEARER is the only auth mechanism. There is no documented anonymous or unauthenticated mode, and I wouldn’...
- 9 kudos
- 51 Views
- 0 replies
- 0 kudos
- 51 Views
- 0 replies
- 0 kudos
- 126 Views
- 3 replies
- 1 kudos
Resolved! Zerobus Variant Data not Processed as Expected (json data destined for Variant column).
Lets say I have a table receiving zerobus data (json) over HTTP/rest.That last VARIANT is "ValueJson".If I want to submit data to it, I would expect to be able to use normal json formatting:[ { "a": "E", "b": 123, "c": "xy...
- 126 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Agree it feels unnatural, but you can hide it from the remote client with a thin encoding step right before sending, so producers keep working with normal nested JSON.A small helper that encodes only the VARIANT columns:import jsonVARIANT_COLUMNS = {...
- 1 kudos
- 218 Views
- 3 replies
- 0 kudos
Resolved! Service principals created by Genie App builder are not visible in Databricks UI
I created a Chat Assistant application using Databricks Genie App Builder, which automatically created a dedicated service principal for the application.The service principal requires access to the relevant Genie Space and catalog to run successfully...
- 218 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Bhawana,I'm running into a similar issue except the solution provided does not work - the service principal created by the Genie App Builder doesn't exist in the Account Console. I've tried looking it up by both name and application ID, but I can'...
- 0 kudos
- 46 Views
- 0 replies
- 0 kudos
- 46 Views
- 0 replies
- 0 kudos
- 53 Views
- 0 replies
- 0 kudos
Databricks Apps vs Model Serving: Authentication, Cost, and Performance Compared
Presented by Arthur Dooner
- 53 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1499 | |
| 1255 | |
| 1188 | |
| 961 |
Latest from our Blog
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 2)
Part 1 introduced the pattern for verifiable visual AI. Let the model find the evidence, use deterministic code to measure it, apply governed rules to produce a pass, review, or fail verdict, and send...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 1)
AI adoption has moved much faster than measurable business results. McKinsey reports that 88% of organizations now use AI in at least one business function, yet only 39% see a bottom-line effect. A co...
Minimize disruptions for continuous pipelines with Maintenance Windows
Minimize disruptions for continuous pipelines with Maintenance Windows In an agentic world, it is more important than ever to make decisions using the latest available data. To achieve this, data engi...
Introducing session restore for serverless jobs
Serverless jobs make it easy to run production notebook workloads at scale, but until now, the state of a run was gone once it ended. If a pipeline ran for hours and failed on the last step, the varia...
