Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, August 20, 2026! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data...
- 261 Views
- 0 replies
- 2 kudos
Tuesday
VIRTUAL TRAINING Time: AMER Aug 19 – Aug 20, 2026 | 9:00 AM PT / 12:00 PM ET Register for the Workshop Note: Marking RSVP on this Community event does not register you for the workshop. Please use the Register button above to complete your registr...
- 2052 Views
- 1 replies
- 6 kudos
3 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 273 Views
- 0 replies
- 1 kudos
Tuesday
Congratulations to all members who have received the new Databricks Partner badge! Your badge recognizes your affiliation with the Databricks Partner ecosystem and helps community members quickly identify trusted partner professionals across discuss...
- 3234 Views
- 41 replies
- 9 kudos
2 weeks ago
WEBINARTime:AMER - Aug 13, 10:00 AM PT / 1:00 PM ETEMEA - Aug 13, 9:00 AM GMT / 10:00 AM BST / 11:00 AM CESTAPAC - Aug 13, 9:30 AM IST / 12 PM SGT / 1PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: M...
- 932 Views
- 0 replies
- 1 kudos
2 weeks ago
New in Community Say hello to the Genie Hub Your questions about Databricks Genie, answered by the people actually building with it. Ask the community anything about Genie… Ask → Genie runs on plain-language conversation - you ask, it answers f...
- 1087 Views
- 1 replies
- 5 kudos
3 weeks ago
Help Your Knowledge Reach More People Every Technical Blog, Community Article, MVP article, or answer you share can help someone beyond the Databricks Community. Small improvements in how you write can make your content easier to discover through C...
- 1654 Views
- 1 replies
- 4 kudos
a month ago
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud to recognize the inc...
- 342 Views
- 4 replies
- 6 kudos
Monday
In programmatic advertising, the value of an impression depends on whether an ad is viewed by a user. The Real-Time Bidding Optimization Solution Accelerator shows how to predict ad viewability and use those insights to optimize bidding strategies, m...
- 385 Views
- 0 replies
- 1 kudos
a week ago
The Weekly Digest • August 3 – 9 Community Pulse A new week, a fresh wave of articles, answers, and discussions. Here's your weekly catch-up. This Week's Community Stars The members who showed up and made a difference this week: @balajij8 @T...
- 178 Views
- 1 replies
- 3 kudos
yesterday
Community Activity
- 112 Views
- 2 replies
- 0 kudos
Error DELTA_CATALOG_MANAGED_TABLE_UPGRADE_WITH_OTHER_PROPERTIES during catalog commit upgrade
Hi everyone,I'm encountering an issue with the Catalog Commit functionality while attempting to upgrade a table, following the official Databricks documentationCatalog commits | Databricks on AWSWhen running the following command on a Managed Iceberg...
- 112 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
This looks like an interaction between the catalog-managed protocol upgrade and VARIANT shredding, rather than an issue with the SQL syntax itself.delta.feature.catalogManaged needs to be enabled as a standalone table/protocol upgrade. In this case, ...
- 0 kudos
- 21 Views
- 0 replies
- 0 kudos
Omnigent Meta-Harness
If you haven't tried Omnigent yet, you are missing out. Give a try and thank me later.https://lnkd.in/p/dTx3erHw
- 21 Views
- 0 replies
- 0 kudos
- 5410 Views
- 3 replies
- 1 kudos
Reading Excel files with Spark returns formula values instead of computed values
Hi,I'm seeing inconsistent behavior when reading Excel files using the built-in connector Lakeflow Connector with spark.read.format("excel") (doc: https://docs.databricks.com/aws/en/query/formats/excel). I read an .xlsx file from S3 using this functi...
- 5410 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
This is admittedly partially an advertisement, since I wrote it, but I think it's useful here, so I'll share it.My team and I have implemented (what I believe to be) the first bug-for-bug, bit-perfect math, calculation engine for xlsx files. It works...
- 1 kudos
- 34 Views
- 0 replies
- 0 kudos
facing issue in llm models
i have signed up to databricks using aws but when i try to access model i m getting error Error (403): PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0.
- 34 Views
- 0 replies
- 0 kudos
- 28 Views
- 0 replies
- 0 kudos
Excel Add-in Regression - Sign-in opens external browser window instead of embedding in task pane, r
Issue: The Databricks Excel Add-in launches authentication in an external browser window rather than within the Excel task pane. The Unity Catalog does display in the external browser window, but after sign-in, Excel remains stuck spinning/loading in...
- 28 Views
- 0 replies
- 0 kudos
- 42 Views
- 0 replies
- 0 kudos
why micro-batching matters so much in Databricks Auto Loader and Structured Streaming
I recently spent some time understanding why micro-batching matters so much in Databricks Auto Loader and Structured Streaming, and it changed the way I look at streaming pipelines.Earlier, I used to think streaming meant processing every record the ...
- 42 Views
- 0 replies
- 0 kudos
- 51 Views
- 0 replies
- 0 kudos
End-to-End Streaming NLP Pipeline with GDELT, Azure Data Factory, ADLS Gen2 and Databricks
I have been working on a project to understand Databricks end to end, rather than just loading some data and training a model.I picked GDELT news data and the use case is to identify supply chain disruption related news and eventually predict which e...
- 51 Views
- 0 replies
- 0 kudos
- 43 Views
- 0 replies
- 0 kudos
How to extract data from SAP to Databricks?
Hey everyone, I'm working through a project where I need to get data out of SAP S4Hana and into Databricks, and I'd love to pick the brains of anyone who's done this before.A few things I'm trying to figure out:How are you actually pulling the data o...
- 43 Views
- 0 replies
- 0 kudos
- 64 Views
- 1 replies
- 1 kudos
Resolved! Lakebase synced table doesn’t recognize Auto CDF on a SDP materialized view
I’m trying to create a triggered Lakebase synced table from a SDP-created materialized view.The source MV uses Automatic CDF: row tracking is enabled and legacy CDF (delta.enableChangeDataFeed) is disabled. The Automatic CDF workspace preview is enab...
- 64 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Short answer: No — Lakebase synced tables in Triggered/Continuous mode do not currently support Automatic CDF from materialized views. This is a documented limitation, not a configuration issue.The synced tables documentation explicitly states:"Sourc...
- 1 kudos
- 129 Views
- 1 replies
- 0 kudos
Does enabling variantType-preview disable file-level data skipping for columns after a VARIANT colum
I have a Delta table (Unity Catalog, liquid clustering) where file-level data skipping never prunes files — a narrow predicate on the clustered timestamp column still reads every file (Files pruned = 0), even though row-group skipping works. The tabl...
- 129 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Alex13 , thanks for the detailed minimal repro. Isolating variantType-preview as the trigger was the hard part, and it makes your three questions answerable. Here is my read. Is this expected? Not according to anything public. The only documente...
- 0 kudos
- 4313 Views
- 5 replies
- 3 kudos
Testing ai_parse_document vs PyMuPDF for PDF extraction
I’ve been experimenting with the Databricks AI functions and recently ran a small test extracting structured information from a PDF document.My initial approach was to use ai_parse_document to extract the text from the PDF.While the function appeared...
- 4313 Views
- 5 replies
- 3 kudos
Latest Reply
- 3 kudos
Great points here! I'm using a similar hybrid approach in production:PyMuPDF runs on everything first, it extracts native text from digital PDFs (fast, free, zero AI cost). Any PDF that returns no text gets tagged as needs_ocr.Only the needs_ocr docu...
- 3 kudos
- 140 Views
- 1 replies
- 3 kudos
Databricks Community Fellows – July 2026 Recap
Monthly Recap • July 2026 Community Fellows If you're new here: the Community Fellows are Databricks employees who volunteer their expertise in the Community forums, helping customers solve real problems. July closed out the quarter with the Fel...
- 140 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
Kudos to all the Community Fellows for their contributions This gamification looks cool though @Tushar_Parekar!
- 3 kudos
- 87 Views
- 0 replies
- 1 kudos
Gear Up: The Next Databricks Community Challenge is Almost Here!
Pre-Announcement Databricks Community Virtual Challenge Gear Up for theNext Challenge Launching • Monday, August 17 Hey Databricks Community! Get your tools ready and save the date - a brand new Virtual Challenge is dropping very soon! Whethe...
- 87 Views
- 0 replies
- 1 kudos
- 22113 Views
- 4 replies
- 0 kudos
Azure Databricks Unity Catalogue Limits
In Azure, what are the limits of Unity Catalogue? One UC per region per subscription, or is it one UC per region per tenant?
- 22113 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
Does it mean we will have DEV, TEST, PROD catalog in a single Unity catalog?
- 0 kudos
- 87 Views
- 2 replies
- 2 kudos
Resolved! Can I use a corporate voucher on my personal Databricks account? (Plus: discount type & expiry)
Hi Databricks Community,I received a certification voucher sent to my corporate email address, and I have a few questions I couldn't find clear answers to in the public docs. I was hoping someone here could help clarify:Can I use this voucher on my p...
- 87 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @javierGarcia ,1. Yes 2. If you company is a partner company and it's your first attempt then the voucher should give you 50% discount. If you already have cert and you need to renew it then this will be for free for partners3. Usually it's valid ...
- 2 kudos
Announcements
| User | Count |
|---|---|
| 2286 | |
| 1358 | |
| 1250 | |
| 1184 | |
| 961 |
Latest from our Blog
LLMOps for Data Scientists and AI Builders: A Quickstart on Databricks
Building an LLM-powered prototype is easy. A few lines of code, a hosted model, and you have an agent that classifies tickets, summarizes documents, or answers questions. The hard part comes after: me...
Migrate your Dashboards to AI/BI with Genie Code
This blog post will resonate if you/your company fit into any of the following profiles: Your data models are stuck into specific dashboards that are maintained by few specialized people.You don't hav...
Triggered vs. Continuous Mode: A Deep Dive into Serverless Lakeflow Spark Declarative Pipelines
One pipeline woke up every five minutes. The other stayed running. Using the same e-commerce streaming workload, median end-to-end data freshness improved from 4.0 minutes to 33 seconds, while P95 lat...
How to Build, Test, and Ship SQL Pipelines on Databricks
SQL is a first-class language in SDP SQL is a first-class language in Spark Declarative Pipelines (SDP). You can build, test, and ship an entire pipeline in SQL. This makes it a powerful tool for thos...
