Overview

The Unstructured Platform is a no-code user interface, pay-as-you-go platform for transforming your unstructured data into data that is ready for Retrieval Augmented Generation (RAG).

To start using the Unstructured Platform right away, skip ahead to the quickstart.

How does it work?

To get your data RAG-ready, the Unstructured Platform moves it through the following process:

1

Connect

The Unstructured Platform offers multiple source connectors to connect to your data in its existing location.

2

Route

Routing determines which strategy Unstructured Platform uses to transforming your documents into Unstructured’s canonical JSON schema. The Unstructured Platform provides these partitioning strategies for document transformation:

• Fast is great for when there is extractable text available, like in HTML files or in the Microsoft Office Document format.
• Hi Res is best for PDFs and tables and where accurate classification of document elements is critical.
• If you’re unsure which strategy to use, choose Auto, and the Unstructured Platform will handle the decision for you.

3

Transform

Your source document is transformed into Unstructured’s canonical JSON schema. Regardless of the input document, this JSON schema we gives you a standardized output. It contains more than 20 elements, such as Header, Footer, Title, NarrativeText, Table, Image, and many more. Each document is wrapped in extensive metadata so you can understand languages, file types, sources, hierarchies, and much more.

4

Chunk

The Unstructured Platform provides these chunking strategies:

• Basic combines sequential elements up to specified size limits. Oversized elements are split, while tables are isolated and divided if necessary. Overlap between chunks is optional.
• By Title uses semantic chunking, understands the layout of the document, and makes intelligent splits.
• By Page attempts to preserve page boundaries when determining the chunks’ contents.
• By Similarity uses an embedding model to identify topically similar sequential elements and combines them into chunks.

5

Enrich

Images and tables can be optionally summarized. This generates enriched content around the images or tables that were parsed during the transformation process.

6

Embed

The Unstructured Platform uses optional third-party embedding providers such as OpenAI.

7

Persist

The Unstructured Platform offers multiple destination connectors, including all major vector databases.

To simplify this process and provide it as a no-code solution, the Unstructured Platform brings together four key concepts:

1

Source Connector

Source connectors to ingest your data into the Unstructured Platform for transformation.

2

Destination Connector

Destination connectors tell the Unstructured Platform where to write your transformed data to.

3

Workflow

Workflows connect sources to destinations and provide chunking, embedding, and scheduling options.

4

Jobs

Jobs enable you to monitor data transformation progress.

What support is there for compliance?

The platform is designed for global reach with SOC2 Type 1, SOC2 Type 2, and HIPAA compliance. It has support for over 50 languages.

How do I get started?

Skip ahead to the quickstart.