cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Databricks Advanced Learning Festival: September 16 - October 14 2026

Databricks Advanced Learning Festival September 16 – October 14, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are...

  • 224470 Views
  • 370 replies
  • 94 kudos
08-21-2026
Level Up Your Databricks Skills: Learning Paths & Free Live Training

FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...

  • 1401 Views
  • 3 replies
  • 5 kudos
2 weeks ago
Community BrickTalk | Databricks Certification: Did You Know?, What's New, and Where We're Going

Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 8, 2026! Bricktalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Data...

  • 1161 Views
  • 1 replies
  • 2 kudos
a week ago
DATA + AI World Tour 2026

REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...

  • 1915 Views
  • 0 replies
  • 3 kudos
09-01-2026
Join the Live AI/BI + Genie Launchpad (Oct 6–8)

Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...

  • 1950 Views
  • 0 replies
  • 3 kudos
Thursday
Databricks Community Champion - September 2026 - Venugopal Dabbara

Community Champion • September 2026 Meet Venugopal Dabbara Every month, our Community Champion Program recognizes a member who makes the Databricks Community better for everyone, through their knowledge, their willingness to help, and their commitmen...

  • 207 Views
  • 0 replies
  • 6 kudos
Tuesday
Solution Accelerator Series | IOC Matching and Multicloud Query Federation

Cybersecurity in multicloud, multiregion environments can be complicated by fragmented security controls, data dispersion and compliance requirements. The IOC Matching and Multicloud Query Federation Solution Accelerator shows how a lakehouse platfor...

  • 121 Views
  • 0 replies
  • 1 kudos
Tuesday

Community Activity

Wola
by > • New Contributor II
  • 375 Views
  • 4 replies
  • 1 kudos

Data ingestion: Setting up a connector for Postgres with CDC enabled.

Hello,I'm trying to ingest data from my RDS instance and set up change data capture on Databricks. Everything on the Postgres side has been done so that replication is possible, but CDC is still greyed out. I have asked Claude, Gemini, and ChatGPT. I...

Wola_0-1789753526825.png
  • 375 Views
  • 4 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @Wola, I did some digging and here is what I found. @ThomazNeto already pointed you at the two things that matter most: the PostgreSQL connector for Lakeflow Connect is in Public Preview and needs workspace enrollment, and logical replicati...

  • 1 kudos
3 More Replies
dsay96
by > • New Contributor II
  • 491 Views
  • 6 replies
  • 4 kudos

using remote_query with SQL Serverless Warehouse

Hello, Im trying to set up remote_query() as an option for our developers to use when querying our DB2 server. Unfortunately the connection keeps timing out. The workspace is in a VPC in AWS and the interactive clusters can successfully use the JDBC ...

  • 491 Views
  • 6 replies
  • 4 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 4 kudos

Hello @dsay96, I took a look at both internal and external documentation and here is what I found. TLS probably isn't your blocker. @aayush_410 called it: a bad certificate throws a handshake or PKIX error, not a timeout. A timeout with every compone...

  • 4 kudos
5 More Replies
DB1To3
by > • Contributor II
  • 106 Views
  • 5 replies
  • 2 kudos

Zerobus Ingest with Kafka compliant API and WITHOUT a callback

Is see that kafka for zerobus is still in beta.  So maybe something will change. Can someone tell me whether they are aware of an authentication handshake with this API that might AVOID the callback?Here is the python example, which uses a sophistica...

  • 106 Views
  • 5 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hello @DB1To3,  Glad we beat Reddit to it. You read the VNet point right. There's no anonymous mode, and the Kafka endpoint is public only (no front-end Private Link yet), so "anyone who can reach it" would mean the whole internet writing into your U...

  • 2 kudos
4 More Replies
kohei-matsumura
by > • Databricks Partner
  • 213 Views
  • 9 replies
  • 13 kudos

Best practices for DR & Checkpoint Management of Serverless Declarative Pipelines (ST/MV)?

I am currently designing a Disaster Recovery (DR) strategy for our Databricks workspace to recover from system failures and human errors. Our main requirement is to restore both the data and the pipelines reliably if a workspace goes down or gets cor...

  • 213 Views
  • 9 replies
  • 13 kudos
Latest Reply
Aravind_Reddy
Databricks Partner
  • 13 kudos

Thanks for the detailed explanation everyone. The Active-Passive + replay/rebuild approach makes sense given that Serverless manages the checkpoint state internally.One aspect I’m curious about is how this pattern should be designed when the source d...

  • 13 kudos
8 More Replies
priya9896
by > • New Contributor II
  • 415 Views
  • 9 replies
  • 2 kudos

Azure to AWS

Hi everyone,We're evaluating an architecture pattern and would appreciate any guidance or recommendations. Has anyone implemented a similar cross-cloud pattern? Specifically:Can AWS Glue be used to access Azure Databricks data without copying it?Are ...

  • 415 Views
  • 9 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Also, if you feel your question has been answered please "Accept as Solution" so that others can benefit.  Cheers, Lou.

  • 2 kudos
8 More Replies
Ramesh_01
by > • Visitor
  • 30 Views
  • 0 replies
  • 0 kudos

Genie Code chat history monitoring of other users

Hi community,My organization has asked me to monitor how our team uses Genie Code (formerly Databricks Assistant). I'm a regular workspace user, not an admin, and so are my teammates. Asking each person to share their chats individually isn't practic...

  • 30 Views
  • 0 replies
  • 0 kudos
DB1To3
by > • Contributor II
  • 92 Views
  • 3 replies
  • 0 kudos

Trouble while Maintaining Databricks Genie Agents (VS code extension available?)

Is there an update to the databricks extension for VS code that will allow me to work with "genie agents" (aka spaces)?I'm having a really hard time with the editing of these agents in the Azure workspace environment.  There are lots of things missin...

Screenshot 2026-10-07 183939.png
  • 92 Views
  • 3 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short answer: the Databricks extension for VS Code doesn't have a Genie space editor, and I'm not aware of one on a roadmap I can point you to. Genie space authoring (sources, instructions, examples) lives in the workspace UI, so you can't currently...

  • 0 kudos
2 More Replies
Tushar_Parekar
by • Databricks Employee
  • 1161 Views
  • 1 replies
  • 2 kudos

Community BrickTalk | Databricks Certification: Did You Know?, What's New, and Where We're Going

Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 8, 2026! Bricktalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with Data...

Bricktalk_final.png
  • 1161 Views
  • 1 replies
  • 2 kudos
Latest Reply
Tushar_Parekar
Databricks Employee
  • 2 kudos

Last chance to lock in your spot! Don't miss out on today's BrickTalk on Databricks Certification: Did You Know?, What's New, and Where We're Going! Whether you're preparing for your Associate exam, aiming for advanced certifications, or guiding pee...

  • 2 kudos
AnhPT
by > • New Contributor III
  • 357 Views
  • 4 replies
  • 1 kudos

Deployment Jobs structured yaml.

 Does DAB support any form of task reuse or shared task templates across job definitions — so the wrapper tasks don't need to be physically repeated in every file?Is there a recommended pattern to externalize the orchestration wrapper (logging, skip ...

  • 357 Views
  • 4 replies
  • 1 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 1 kudos

Short answer: DAB has no native task-level templates or includes. A YAML file can't say "inject these 5 tasks into every job." Reuse has to come from one of three places: generating the YAML (what you do today), Python for bundles, or moving the wra...

  • 1 kudos
3 More Replies
Danish11052000
by > • Contributor
  • 272 Views
  • 4 replies
  • 0 kudos

How to bring the project id info into the databricks billing usage table on GCP

Hi,We are using Databricks on GCP and are currently analyzing costs using the billing usage/system tables.One challenge we are facing is that the billing usage data provides usage and cost information, but we are unable to identify the associated GCP...

  • 272 Views
  • 4 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

There's no GCP project ID column in system.billing.usage, but you don't need one. On GCP, each Databricks workspace is deployed into a specific GCP project, so you map workspace_id to project ID yourself and join. For finer granularity within a work...

  • 0 kudos
3 More Replies
r_w_
by > • Databricks Partner
  • 256 Views
  • 2 replies
  • 0 kudos

What information about external agents can be retrieved from Unity Catalog?

Databricks provides a beta feature called Agent Services. My understanding is that this feature allows external agents to be registered in Unity Catalog.Could someone clarify what information or metadata about a registered external agent can actually...

  • 256 Views
  • 2 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

The API exists and works today during the beta. It's a Unity Catalog REST endpoint, /api/2.1/unity-catalog/agent-services, and it's documented only on the Agent Services page, not in the API reference [1]. Registration, metadata retrieval and permis...

  • 0 kudos
1 More Replies
sbanchik
by • Databricks Employee
  • 72 Views
  • 0 replies
  • 1 kudos

Introducing session restore for serverless jobs

Serverless jobs make it easy to run production notebook workloads at scale, but until now, the state of a run was gone once it ended. If a pipeline ran for hours and failed on the last step, the variables, DataFrames, and other intermediate state you...

jobsforklowquality.gif jobsforkgenielowqual.gif Screenshot 2026-10-01 at 1.25.45 PM.png session-restore-blog-banner-1200x628.png
  • 72 Views
  • 0 replies
  • 1 kudos
Danish11052000
by > • Contributor
  • 81 Views
  • 1 replies
  • 0 kudos

Managed Omnigent on Databricks can't use external model providers (Az OpenAI,Gemini)in Unity Gateway

SetupAzure Databricks workspace with the Omnigent and Databricks Sandbox previews enabled.Unity Gateway has two external providers registered as model provider services: Azure OpenAI and Gemini Enterprise.Both work when called directly through /ai-ga...

  • 81 Views
  • 1 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short answer: from what you've traced, there's no supported way today to point managed Omnigent at Unity Gateway model provider services. Both the model picker and the ug auto-configure path are scoped to system.ai foundation-model endpoints. Since ...

  • 0 kudos
Krishinas
by > • New Contributor II
  • 171 Views
  • 3 replies
  • 0 kudos

My data saved in the account lost

Hi, I was using databricks free edition and was having few learning data saved and running all off sudden, asked me to sign up again and i lost my data how to restore 

  • 171 Views
  • 3 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Most likely you're not seeing lost data. You've landed in a different Databricks account/workspace than the one your Free Edition work lives in. When the sign-in flow asked "free or subscription" and you went through OTP again, it probably created o...

  • 0 kudos
2 More Replies
MarshallCarter
by • Databricks Employee
  • 71 Views
  • 0 replies
  • 0 kudos

From Batch to Milliseconds: Real-Time Feature Views for Recommenders

Every click, search, and hover on a retailer’s website tells a story about what a shopper wants right now, but feature engineering pipelines, traditionally updated in batches, capture that story after the shopper has left. Databricks Feature Views cl...

image_1.png image_2.png image_3.png image_4.png
  • 71 Views
  • 0 replies
  • 0 kudos
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges, and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Join Learning Events here in the Community.

Connect with peers through Databricks User Groups and learn more about Community Events happening near you. We’re excited to see you get involved.

Top Kudoed Authors

Latest from our Blog

Introducing session restore for serverless jobs

Serverless jobs make it easy to run production notebook workloads at scale, but until now, the state of a run was gone once it ended. If a pipeline ran for hours and failed on the last step, the varia...

Image
72Views 1kudos