Grow Your Skills and Earn Rewards! Mark your calendar: 16 March – 03 April, 2026 Join us for a three-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whet...
- 1204 Views
- 14 replies
- 5 kudos
Sunday
Join us for a new Community [Industry] BrickTalk: Scaling BioPharma Intelligence With the Databricks Agentic Clinical Ops Ecosystem! In this session, we are coming at you with a super cool BioPharma use case in which AI-powered Databricks agents tran...
- 182 Views
- 0 replies
- 2 kudos
Monday
We are back with instructor-led Databricks Learning Festivals for APAC & EMEA! Both Udemy and LinkedIn recognized Databricks as one of the top fastest growing skills for 2026 — Udemy's The 100 Fastest-Growing Global Skills for 2026 and LinkedIn's T...
- 810 Views
- 2 replies
- 3 kudos
a week ago
June 15–18, 2026 Register Now! Join thousands of data analytics and AI professionals at Data+ AI Summit 2026, the world’s largest conference for data, analytics and AI in San Francisco and virtually. Don’t miss early-bird pricing! Early-bird discoun...
- 1755 Views
- 1 replies
- 1 kudos
3 weeks ago
OverviewTo enhance security and reliability, Databricks is updating the trusted TLS Certificate Authorities (CAs) that issue certificates for our public-facing websites and API endpoints. This change ensures continued compliance with industry best pr...
- 1070 Views
- 3 replies
- 2 kudos
01-30-2026
Our new Claims Management Automation Solution Accelerator helps insurance teams streamline and modernize their claims workflows. This accelerator comes with pre-built code, sample data and step-by-step instructions packaged in a Databricks notebook, ...
- 425 Views
- 0 replies
- 2 kudos
a week ago
Our Community Champion Program celebrates members who go the extra mile to share knowledge, support fellow practitioners, and help the Databricks Community grow stronger every day. These champions bring curiosity, experience, and a genuine willin...
- 323 Views
- 4 replies
- 7 kudos
yesterday
This week, the Community once again turned curiosity into conversations and conversations into solutions. From insightful blogs to technical troubleshooting, there was plenty to learn from: Spotlight Contributors These members kept the convers...
- 111 Views
- 0 replies
- 5 kudos
yesterday
Community Activity
- 24 Views
- 4 replies
- 0 kudos
Resolved! I am waiting the Verify code but not happens
I am waiting the Verify code but not happens .Is the free edition Down?
- 24 Views
- 4 replies
- 0 kudos
- 1 Views
- 0 replies
- 0 kudos
Microsoft just announced a new certification: Microsoft Certified: Azure Databricks Data Engineer
Microsoft has just announced a new certification: Microsoft Certified: Azure Databricks Data Engineer Associate (Exam DP-750)This certification is entirely focused on building data engineering solutions using Azure Databricks, with deep integration i...
- 1 Views
- 0 replies
- 0 kudos
- 26 Views
- 1 replies
- 2 kudos
How Much Has AI Actually Changed Your Day to Day?
Community, I'm genuinely curious: Describe your workday two years ago vs. today in a sentence or two. I'll go first: then, I spent half my day context-switching between Drive, Sheets, Docs, and Slack just trying to find what I needed. Now, I vibe cod...
- 26 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Two years ago, I was working in a Presales capacity. My workday was often defined by a reliance on others (close to the customer) to provide customer context and a struggle with the hazy procrastination that comes from starting complex slide decks w...
- 2 kudos
- 496 Views
- 13 replies
- 3 kudos
Resolved! unionbyname several streaming dataframes of different sources
Is the following type of union safe with spark structured streaming?union multiple streaming dataframes, and each from a different source.Anything better solution ?for example, df1 = spark.readStream.table(f"{bronze_catalog}.{bronze_schema}.table1") ...
- 496 Views
- 13 replies
- 3 kudos
Latest Reply
- 3 kudos
Thanks @Kirankumarbs, Thanks @SteveOstrowski You have provided very useful information.
- 3 kudos
- 23 Views
- 2 replies
- 0 kudos
How to stop Databricks adding quotes to multi-line selections
I'm using a query to generate some YML code from my tables, and running into an annoying behaviour. Here's a simplified example...Run this query in a notebook or the SQL editor:SELECT 'foo\nbar' FROM system.information_schema.tables LIMIT 10You get a...
- 23 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @ChrisHunt, As Ale_Armillotta mentioned, any field that contains a newline is wrapped in double quotes so that each row still represents a single CSV record. I think that is a logical and expected behaviour. There is currently no setting to turn t...
- 0 kudos
- 19 Views
- 1 replies
- 0 kudos
Issue in receiving my databricks Certificate to wrong email becouse wrong email
Hello team,I passed the Data Engineer associate exam two days ago and still didn't receive my certification till now cause the email provided to Kryterion was wrong, the wrong email was ataamohmed554@gmail.com, but my correct mail is ataamohamed554@g...
- 19 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @Ataa_mohamed11 , Please file a ticket with our support team, support team will respond shortly. Please also provide them with your email address (it is not advised that you post your email address here in community). Please note that we cannot...
- 0 kudos
- 15 Views
- 1 replies
- 0 kudos
Signup issues - Free Edition
Signup issues - Free EditionFrom what I could observe in this community, every now and then, there are signup issues.As of now / today - 13:30 UTCJoining this community worked as expected.Getting access to databricks - Free Edition failed.I received ...
- 15 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @matjung, Having checked our knowledge base, your steps are correct. The error message (401) seems to indicate an issue on the service side of the Free Edition signup flow rather than anything you’re doing wrong. There are a few options you can tr...
- 0 kudos
- 13 Views
- 0 replies
- 0 kudos
Photon not used for the filter step (falls back to COLUMNAR_TO_ROW → FILTER_EXEC in JVM)
We have a custom python notebook used to handle data loading. In this case, it's for a full overwrite of specific partitions. The notebook determines columns to use for the update based on incoming data. It creates a replace condition like this: repl...
- 13 Views
- 0 replies
- 0 kudos
- 10813 Views
- 7 replies
- 3 kudos
Resolved! Didn't receive my certification
I took my databrick certification exam on Jan-27-2023 however didnt receive my certification yet. Raised case to databricks but response too is very poor, didnt receive any response from team yet.
- 10813 Views
- 7 replies
- 3 kudos
Latest Reply
- 3 kudos
I have passed the Databricks Certified Data Analyst Associate yesterday. But I still didn't get my certificate. Please help me
- 3 kudos
- 15 Views
- 0 replies
- 0 kudos
One Cluster per Task — Proven, Ready, and Waiting
Part 3 of 3: Databricks Streaming ArchitectureBy the end of Part 1 & Part 2, we knew what the real answer was. We just hadn’t committed to it yet.Not because it wouldn’t work. We tested it. We documented it. The code was ready. The answer was one clu...
- 15 Views
- 0 replies
- 0 kudos
- 13297 Views
- 12 replies
- 0 kudos
webassessor databricks login not working
https://webassessor.com/databrickslogin not working / authenticating. tried the password reset option and reset the password. when logged back in faced the same login issue. tried multiple browsers, multiple machines and registered with few emails ac...
- 13297 Views
- 12 replies
- 0 kudos
Latest Reply
- 0 kudos
I am facing the same issue. I am unable to access my Webassessor account for Databricks certification. I had originally registered using my organization email address, but I have forgotten my password. When I try to reset it, I do not receive any pas...
- 0 kudos
- 77 Views
- 2 replies
- 0 kudos
Complex Json file Flatten Dynamically
Hi ,We have multiple complex JSON files and need to flatten them, especially handling array data types. Whenever an array is present, we need to create a new child table and establish a relationship between the master and child tables. This will foll...
- 77 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @SantiNath_Dey , Given you’re dealing with multiple complex JSON structures, I agree with a metadata‑driven approach rather than hard‑coding the flattening logic. At a high level: Define a small set of config tables: One for patterns... as in whi...
- 0 kudos
- 4211 Views
- 3 replies
- 0 kudos
Resolved! Issue in receiving my databricks Certificate due to wrong email id
Hi Team, I have given the examination for "Databricks Certified Associate Developer for Apache Spark-Python" on 12th Jan 2024 at 1500 IST. The email id associated with my Kryterion at that time I gave my examination was wrong it had a typo in it. Th...
- 4211 Views
- 3 replies
- 0 kudos
- 2165 Views
- 2 replies
- 0 kudos
Using generative AI to generate descriptions
Hi all, I would like to check if there is a function in databricks notebook that allows users to get AI generated descriptions of dataframes within the session similar to the AI generated descriptions for tables? This is because I am wondering it it ...
- 2165 Views
- 2 replies
- 0 kudos
- 101 Views
- 2 replies
- 0 kudos
Shorten Classic Cluster start up time
We use R notebooks to generate workflow. Thus we have to use classic clusters. And we need roughly 10 additional R packages in addition to 2 pyPI packages. It takes at least 10-20 min to start the cluster. We found the most time taken were the packag...
- 101 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hey @NW1000 — good question, and your instinct to pre-compile and cache is the right one. There are three separate things working against you here, and fixing all three should collapse that 10-20 minute startup significantly. You're pulling source bu...
- 0 kudos
Announcements
![Community [Industry] BrickTalk: Scaling BioPharma Intelligence and Agentic Clinical Ops Ecosystem](https://calendarstemplates.com/t5/image/serverpage/image-id/24660iA21075242DC0E0B9/image-size/large?v=v2&px=999)
| User | Count |
|---|---|
| 2219 | |
| 1185 | |
| 1152 | |
| 1137 | |
| 952 |
| User | Count |
|---|---|
| 407 | |
| 286 | |
| 220 | |
| 63 | |
| 45 |
Latest from our Blog
Lakebase Branching Meets Docker: The Migration Safety Net I Wish I Had Years Ago
Lakebase Branching Meets Docker: The Migration Safety Net I Wish I Had Years Ago Before I became a Solutions Architect at Databricks, I was a backend software engineer and for a few years of my past l...
Design Filters and Parameters That Scale in Databricks AI/BI Dashboards
Why Filters matter Databricks AI/BI Dashboards become truly useful when users can slice data by date, segment, status, or region without editing SQL. Filters make this possible by separating what use...
Spark Declarative Pipelines “How-To” Series. Part 1: How to Save Results Into A Table
Spark Declarative Pipelines “How-To” Series Introduction Lakeflow Spark Declarative Pipelines (SDP) is a framework designed for building scalable, maintainable ETL pipelines. Everyone should want to m...
AI Newsletter Series (Part 2): Designing a Useful LLM Pipeline Across PDFs, Use Cases, and Accounts
In Part 1 of this series, we focused on parsing enterprise PDFs, and this blog we build on that work and show how those chunks are combined with structured use-case data to produce consistent, account...
