Grow Your Skills and Earn Rewards! Mark your calendar: January 09 – January 30, 2026 Join us for a three-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. ...
- 86201 Views
- 266 replies
- 109 kudos
12-09-2025
June 15–18, 2026 Are you building the future with data and AI? Then this is your moment. The Call for Proposals for Data + AI Summit 2026 is officially open, and we want to hear from builders, practitioners, and innovators across the data and AI com...
- 5597 Views
- 4 replies
- 6 kudos
a month ago
How to Register & Prepare If you're interested in advancing your skills with Databricks through a Specialist Session, here's a clear guide on how to register and what free courses you can take to prepare effectively. How to Begin Your Learning Path S...
- 3842 Views
- 2 replies
- 9 kudos
10-02-2025
Strengthening cybersecurity isn’t a one-time project — it’s an ongoing process of adapting to new and complex threats. The focus is on modernizing your data infrastructure and analytics capabilities to make security operations smarter, faster, and mo...
- 589 Views
- 1 replies
- 2 kudos
a week ago
2025 wasn’t just another year on the Databricks Community.It was a year of showing up, helping each other, and building trust. Watch the 2025 Community Wrap-Up This video is a small reflection of that journey.It highlights the key contributors of 2...
- 939 Views
- 13 replies
- 19 kudos
Wednesday
The calendar changed. The conversations didn’t. The year turned somewhere between a solved thread and a new question. No pause. No reset – just learning, continuing right where it left off. Here’s how it unfolded Voices That Moved the Conversatio...
- 269 Views
- 3 replies
- 6 kudos
Tuesday
Community Activity
- 774 Views
- 4 replies
- 4 kudos
Resolved! DBR 17.3.3 introduced unexpected DEBUG logs from ThreadMonitor – how to disable?
After upgrading from DBR 17.3.2 to DBR 17.3.3, we started seeing a flood of DEBUG logs like this in job outputs:```DEBUG:ThreadMonitor:Logging python thread stack frames for MainThread and py4j threads: DEBUG:ThreadMonitor:Logging Thread-8 (run) stac...
- 774 Views
- 4 replies
- 4 kudos
Latest Reply
- 4 kudos
@iyashk-DBWe are currently using DBR version 17.3 LTS, and the issue is still occurring.Do you know when the fix is expected to be applied? We need this information to decide whether we should wait for the fix or proceed with the workaround you propo...
- 4 kudos
- 77 Views
- 5 replies
- 16 kudos
Databricks Community Champion - January 2026 - Raman Gupta
We are excited to spotlight Raman Gupta, one of our most insightful and expert contributors in the Databricks Community, whose journey reflects the spirit of learning, collaboration, and innovation we value most. Here’s more about about Raman in his...
- 77 Views
- 5 replies
- 16 kudos
Latest Reply
- 16 kudos
Inspiring journey, @Raman_Unifeye ! Your vision and secret sauce earned you the Community Champion spotlight . See you around in another thread!
- 16 kudos
- 235 Views
- 4 replies
- 3 kudos
Mongo Db connector - Connection timeout when trying to connect to AWS Document DB
I am on Databricks Run Time LTE 14.3 Spark 3.5.0 Scala 2.12 and mongodb-spark-connector_2.12:10.2.0. Trying to connect to Document DB using the connector and all I get is a connection timeout. I tried using PyMongo, which works as expected and I can ...
- 235 Views
- 4 replies
- 3 kudos
Latest Reply
- 3 kudos
Hi @rijin-thomas - Can you please allow the CIDR block for databricks account VPC from aws document db sg ( Executor connectivity stated by@bianca_unifeye ) .
- 3 kudos
- 42 Views
- 1 replies
- 0 kudos
Tab navigation between fields in dashboards is random
Tab navigation between fields in published dashboards seem very random.I have a dashboard with multiple text input fields (mapped to query paramters / filters). I expect to move logically between them when pressing tab (keyboard navigation), but I mo...
- 42 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @tvdh! You can share this as product feedback so it’s visible to the Databricks product team and can be tracked and prioritized.
- 0 kudos
- 2997 Views
- 2 replies
- 1 kudos
Resolved! Databricks APP OBO User Authorization
Hi All,We are using on-behalf of user authorization method for our app and the x-forwarded-access-token is expiring after sometime and we have to redeploy our app to rectify the issue. I am not sure what is the issue or how we can keep the token aliv...
- 2997 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
I am confronted with a similar error. I am also using obo user auth and have implemented accessing the token via st.context.headers.get('x-forwarded-access-token') for every query and do not save it in a cache. Still, after 1 hour, i am hit with the...
- 1 kudos
- 14 Views
- 0 replies
- 0 kudos
DLT Continuous Pipeline load
Hi All,In our project we are working on the DLT pipeline with the DLT tables as target running in continuous mode.These tables are common for multiple countries, and we go live in batches for different countries.So, every time a new change is request...
- 14 Views
- 0 replies
- 0 kudos
- 275 Views
- 2 replies
- 1 kudos
Delta Sharing from Databricks to SAP BDC fails with invalid_client error
ContextWe are in the process of extracting data between SAP BDC Datasphere and Databricks (Brownfield Implementation).SAP Datasphere is hosted in AWS (eu10)Databricks is hosted in Azure (West Europe)The BDC Connect System is located in the same regio...
- 275 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Thanks for sharing all the details and troubleshooting steps – that’s very helpful context. In the current notebook, open_resource_discovery_information is defined as a Python dict. Before calling create_or_update_share, this structure must be seri...
- 1 kudos
- 182 Views
- 3 replies
- 9 kudos
End of Year Documentation Update 🚀
GCP Documentation - Here’s a roundup of the most important GCP updates from the past month to help you quickly catch up on what’s new and relevant for your workloads. Get started tutorials on Databricks (Updated on Dec 2nd 2025) GET STARTED Sign u...
- 182 Views
- 3 replies
- 9 kudos
- 183 Views
- 5 replies
- 1 kudos
databricks all-purpose cluster
getting below error-Failure starting repl. Try detaching and re-attaching the notebook. while executing notebook and can see cluster have all installed lib.
- 183 Views
- 5 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi,we are not using hive metastore anywhere not sure why that host ((host=consolidated-westeuropec2-prod-metastore-0.mysql.database.azure.com)(port=3306))is coming in driver log ,will i need to do whitelist for that .we are having other use case simi...
- 1 kudos
- 51 Views
- 1 replies
- 0 kudos
Merge with schema evolution fails because of upper case columns
The following is a minimal reproducible example of what I'm facing right now.%sql CREATE OR REPLACE TABLE edw_nprd_aen.bronze.test_table ( id INT ); INSERT INTO edw_nprd_aen.bronze.test_table VALUES (1); SELECT * FROM edw_nprd_aen.bronze.test_tab...
- 51 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Dhruv-22,It's actually not a bug. Let me explain what's happening.The Root CauseThe issue stems from how schema evolution works with Delta Lake's MERGE statement, combined with Spark SQL's case-insensitivity settings.Here's the key insight: spark...
- 0 kudos
- 73 Views
- 3 replies
- 3 kudos
Request for more Vocareum lab time
I didn't realized I drained my lab hours by not closing my screen or ending my labs when I paused for the day. Is there a way to get more lab time on Vocareum?
- 73 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
Hey @Mavvy , if the explanation and feedback helped, please feel free to click “Accept as Solution.” That helps give others confidence in the answer if they run into the same issue down the line. Thanks, Louis.
- 3 kudos
- 39 Views
- 1 replies
- 0 kudos
PERMISSION_DENIED: Request for user delegation key is not authorized.
I am attempting to copy files from an Azure Storage container using an Azure Databricks Volume. When attempting to list files using dbutils.fs.ls('/Volumes/myCatalog/mySchema/myVolume' I get the following error:ExecutionError: (com.databricks.sql.man...
- 39 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @hietpas ,I think your access connector doesn't have sufficient permission to storage account. Check below documentation entry. Try to grant Storage Blob Data Contributor role for your connector.
- 0 kudos
- 35 Views
- 0 replies
- 1 kudos
Mix Shell with Python
Assigning the result of a shell command directly to a Python variable. It is my most significant finding in magic commands and my favourite one so far. Read about 12 magic commands in my blogs: - https://www.sunnydata.ai/blog/databricks-hidden-magic-...
- 35 Views
- 0 replies
- 1 kudos
- 194 Views
- 0 replies
- 2 kudos
Combining Agent Bricks and ai_parse_document for Smarter Document Workflows
Building a Research Paper Curator for Knowledge Assistants Document-heavy workflows such as research analysis, contract review, and support ticket processing, are a natural fit for AI agents. Building them from scratch means orchestrating document pa...
- 194 Views
- 0 replies
- 2 kudos
- 2579 Views
- 3 replies
- 1 kudos
Getting error while creating external delta table in Databricks
I am getting below error while creating external delta table in Databricks, even there is a external location created.[NO_PARENT_EXTERNAL_LOCATION_FOR_PATH] No parent external location was found for path 'abfss://[email protected]...
- 2579 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
@Takuya-Omi @saisaran_g , I'm also facing the similar error, how can I resolve it.[NO_PARENT_EXTERNAL_LOCATION_FOR_PATH] No parent external location was found for path 'abfss://[email protected]/cusdata'. Please create an e...
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2238 | |
| 1224 | |
| 1073 | |
| 998 | |
| 950 |
Latest from our Blog
Combining Agent Bricks and ai_parse_document for Smarter Document Workflows
Building a Research Paper Curator for Knowledge Assistants Document-heavy workflows such as research analysis, contract review, and support ticket processing, are a natural fit for AI agents. Building...
Declarative Pipelines meets foreachBatch: Custom Streaming for Advanced Pipelines
If this is the first time you’re hearing about Sinks in Lakeflow Declarative Pipelines (LDP), we highly recommend reading Introducing the SDP Sink API, which explores the recently launched Sinks API, ...
[PARTNER BLOG] Building an Agent-Native Data Quality Manager with Databricks Apps and DQX
Introduction: The Data Quality ParadoxWhat We BuiltThe Technology StackArchitecture Deep DiveThe Four-Layer ArchitectureLayer 1: UsersLayer 2: Databricks Apps PlatformLayer 3: Compute LayerLayer 4: Da...
[PARTNER BLOG] Zerobus Ingest on Databricks
Introduction TL;DR ZeroBus Ingest is a serverless, Kafka-free ingestion service in Databricks that allows applications and IoT devices to stream data directly into Delta Lake with low latency and mini...
