Skip to content

Add Pixeltable Document Store integration#486

Open
pierrebrunelle wants to merge 1 commit into
deepset-ai:mainfrom
pierrebrunelle:add-pixeltable-integration
Open

Add Pixeltable Document Store integration#486
pierrebrunelle wants to merge 1 commit into
deepset-ai:mainfrom
pierrebrunelle:add-pixeltable-integration

Conversation

@pierrebrunelle
Copy link
Copy Markdown

@pierrebrunelle pierrebrunelle commented May 28, 2026

Summary

Adds a community integration page for haystack-pixeltable — a Haystack Document Store and Retriever backed by Pixeltable.

PyPI: https://pypi.org/project/haystack-pixeltable/
Repo: https://github.com/pixeltable/haystack-pixeltable

Components

  • PixeltableDocumentStore — full Haystack DocumentStore protocol (write, delete, filter, count, serialization)
  • PixeltableRetriever — vector similarity search with top-k and metadata filtering

What makes this integration different

Pixeltable is open-source multimodal data infrastructure. Unlike standalone vector databases, it provides:

  • Computed columns — declaratively define transforms (embeddings, LLM calls, image processing) that auto-run on every insert
  • Version history — built-in time-travel queries over your document store
  • Multimodal types — native Image, Video, Audio, Document column types alongside text and embeddings
  • .table escape hatch — break out of the Haystack interface to use Pixeltable's full API (add computed columns, query versions, multimodal operations)

Checklist

  • .md file in integrations/ with required frontmatter
  • Installation instructions
  • Component list
  • Runnable code examples (Document Store, Retriever, Pipeline, Filtering)
  • License information
  • pypi and repo fields populated

Adds a community integration page for haystack-pixeltable — a Document Store
and Retriever backed by Pixeltable's persistent, versioned, multimodal data
infrastructure.

PyPI: https://pypi.org/project/haystack-pixeltable/
Repo: https://github.com/pixeltable/haystack-pixeltable
Co-authored-by: Cursor <cursoragent@cursor.com>
@pierrebrunelle pierrebrunelle requested a review from a team as a code owner May 28, 2026 04:02
Comment on lines +46 to +57
### Why Pixeltable as a Document Store?

| Feature | Pixeltable | Typical vector DBs |
|---------|-----------|-------------------|
| Persistent storage | Built-in (embedded PostgreSQL) | Varies |
| Computed columns | Native — auto-run transforms on insert | No |
| Version history | Built-in — time-travel queries | No |
| Multimodal types | Image, Video, Audio, Document | Text only |
| Metadata filtering | JSON + SQL predicates | Limited |
| Embedding auto-compute | Via computed columns | Manual |

The `.table` escape hatch lets you break out of the Haystack interface to use the full Pixeltable API — add computed columns, run LLM inference on insert, query version history, and work with multimodal data.
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have doubts regarding including that section. It sounds a bit too overpromotional. We avoid comparing integrations with each other, or doing any sort of benchmarks. This listing is supposed to present the options available.

Comment on lines +1 to +17
---
layout: integration
name: Pixeltable
description: Document Store and Retriever backed by Pixeltable — persistent, versioned, multimodal data infrastructure for AI applications.
authors:
- name: Pixeltable
socials:
github: pixeltable
twitter: pixeltable
linkedin: https://www.linkedin.com/company/pixeltable/
pypi: https://pypi.org/project/haystack-pixeltable/
repo: https://github.com/pixeltable/haystack-pixeltable
type: Document Store
report_issue: https://github.com/pixeltable/haystack-pixeltable/issues
version: Haystack 2.0
toc: true
---
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you think we could also add a logo of Pixeltable, similarly to the other integrations?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants