Examples

Working pipelines you can clone and run. Each one reads a source, transforms it in a Python flow, and keeps a target in sync. Start from the closest one and change the parts that differ.

32 examples

Multimodal search5

Search images, PDFs, slides, and faces by meaning: the same vector index with a different encoder.

Structured extraction6

Extract typed, structured data from code and documents with an LLM, through instructor, BAML, or DSPy.

  1. Multi-repo
  2. Structured output
  3. Local FS

Multi-codebase summarization

Walk many Python repos, LLM-extract a typed summary per file — classes, functions, Mermaid call graphs — and aggregate into an always-fresh wiki page per project.

~35 minAdvanced

  1. HackerNews API
  2. LiteLLM
  3. Postgres
  1. PDF
  2. OpenAI
  3. Postgres

Index academic papers

LLM-extract title, authors, and abstract from academic PDFs into typed rows, embed them, and store it all in Postgres with pgvector.

~12 minIntermediate

  1. PDF
  2. BAML
  3. JSON files

Patient intake forms to typed JSON with BAML

Extract schema-validated patient records from intake-form PDFs with one type-safe BAML Gemini-vision call per file, writing a JSON file per form.

~10 minIntermediate

  1. PDF
  2. Structured extraction
  3. JSON files

Patient intake forms to typed JSON with DSPy

Render patient intake PDFs to images and extract a typed Patient with a DSPy ChainOfThought vision module on Gemini, writing one validated JSON file per form.

~10 minIntermediate

  1. Local FS
  2. docling + LLM
  3. Postgres

Manuals to structured data

Convert PDF manuals to Markdown with docling, LLM-extract a typed module summary (classes, methods, arguments), and store one structured record per manual in Postgres.

~20 minIntermediate

Knowledge graphs4

Give agents a persistent, graph-shaped memory built from conversations, meetings, and products.

Ingest and transform6

Move and reshape data with the same declarative flow: your own source, target, or parser.

  1. PDF
  2. Custom blocks
  3. Local FS

PDF to Markdown

Convert a folder of PDFs to Markdown incrementally, with custom building blocks: only new or changed PDFs are converted again.

~18 min

  1. Local FS
  2. Kafka

CSV to Kafka

Watch a folder of CSV files and publish each row as a JSON message to a Kafka topic — declarative target states, only-changed-rows produces, and live mode in ~60 lines.

~12 minStarter

  1. Audio files
  2. Transcription
  3. Postgres

Audio to text

Transcribe local audio files with a LiteLLM speech-to-text model and store one transcript row per file in Postgres, keyed by filename.

~12 minStarter

  1. Postgres
  2. Embeddings

Postgres as a source

Read rows from an existing Postgres table, derive fields, embed each row, and write the vectors back to Postgres with pgvector.

~8 minStarter

  1. Local FS
  2. markdown-it-py

Transform a folder of files

The smallest end-to-end CocoIndex pipeline — watch a folder of Markdown, render each file to HTML, and write the outputs to a local folder incrementally.

~6 minStarter

  1. Kafka
  2. LanceDB

Consume Kafka into LanceDB

Consume JSON messages off a Kafka topic and dispatch each one — by its shape — into the matching LanceDB table.

~10 minIntermediate

Can't find the shape you need?

Clone the closest example, swap the source or the target, and keep the rest. Or open an issue and describe the pipeline.