> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.prolific.com/api-reference/ai-task-builder/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.prolific.com/_mcp/server. # AI Task Builder AI Task Builder provides two distinct approaches for human data work: **Batches** for annotating and evaluating existing data, and **Collections** for gathering original data from participants. Both approaches integrate with Prolific's participant pool and share core functionality like instruction types and quality controls, but they're designed for fundamentally different workflows. ## Batches vs Collections The key difference comes down to the direction of data flow: * **AI Task Builder Batch**: You provide data, participants evaluate it * **AI Task Builder Collection**: Participants provide data, you receive it | | Batch | Collection | | ------------------------ | ----------------------------------------------- | ------------------------------------------ | | Data source | Researcher-provided dataset | Participant-generated | | Participant task | Annotate, label, or evaluate datapoints | Submit original content via instructions | | Participant allocation | Taskflow (different datapoints per participant) | Standard study (same instructions for all) | | `data_collection_method` | `AI_TASK_BUILDER_BATCH` | `AI_TASK_BUILDER_COLLECTION` | ## When to use a Batch Use an AI Task Builder Batch when you have existing data that needs human judgement. Typical use cases include: * **Labeling and classification** — categorizing text, images, or other content * **Model evaluation** — rating AI-generated outputs for quality, accuracy, or safety * **Pairwise comparison** — selecting the better of two options * **Quality assurance** — verifying generated content meets requirements * **Ground truth creation** — building labeled datasets for model training With Batches, you upload a dataset (typically via CSV), and AI Task Builder distributes datapoints across participants via Taskflow. Each participant sees a subset of your data, and you can configure how many annotators evaluate each datapoint. ## When to use a Collection Use an AI Task Builder Collection when you need participants to provide original content. Typical use cases include: * **Image collection** — gathering photos for training data (e.g., medical images, handwriting samples) * **Data donation** — collecting files or documents from participants * **Structured surveys with uploads** — multi-step forms that include file submissions * **Content creation** — gathering written responses, recordings, or other original material With Collections, you define pages containing instructions and optional reference content. All participants complete the same flow, submitting their responses and uploads as they progress through each page. ## Core concepts Both Batches and Collections share some common building blocks: ### Instructions Instructions define what you're asking participants to do. Available instruction types include: * **Multiple choice** — single selection from options * **Checkbox** — multiple selections from options * **Free text** — open-ended text input * **File upload** — participants submit files (images, documents, etc.) Batches also support **video narration**, which records a participant's spoken narration while they watch a video. ### Publishing Both Batches and Collections are attached to a Prolific study for publishing. When creating the study, you specify: * `data_collection_method`: Either `AI_TASK_BUILDER_BATCH` or `AI_TASK_BUILDER_COLLECTION` * `data_collection_id`: The ID of your Batch or Collection ```json { "name": "My Study", "data_collection_method": "AI_TASK_BUILDER_BATCH", "data_collection_id": "{{BATCH_OR_COLLECTION_ID}}", // ... other study configuration } ``` ## Next steps #### [Working with Batches](ai-task-builder/batches) Learn the workflow for setting up annotation tasks with your own datasets #### [Working with Collections](ai-task-builder/collections) Learn the workflow for gathering original data from participants --- By using AI Task Builder, you agree to our [AI Task Builder Terms](https://prolific.notion.site/Researcher-Terms-7787f102f0c541bdbe2c04b5d3285acb). ## Docs - [Batches](https://docs.prolific.com/api-reference/ai-task-builder/batches.md) - [Exporting Batch Data](https://docs.prolific.com/api-reference/ai-task-builder/exporting-batch-data.md) - [Collections](https://docs.prolific.com/api-reference/ai-task-builder/collections.md) - [Exporting Collection Data](https://docs.prolific.com/api-reference/ai-task-builder/exporting-collection-data.md) - [Datasets](https://docs.prolific.com/api-reference/ai-task-builder/datasets.md) - [Defining a Dataset Schema](https://docs.prolific.com/api-reference/ai-task-builder/defining-a-dataset-schema.md) - [Uploading Data](https://docs.prolific.com/api-reference/ai-task-builder/uploading-data.md) - [Migrating a Dataset Schema](https://docs.prolific.com/api-reference/ai-task-builder/migrating-a-dataset-schema.md) - [Appending Data](https://docs.prolific.com/api-reference/ai-task-builder/appending-data.md) - [Syncing a Batch](https://docs.prolific.com/api-reference/ai-task-builder/syncing-a-batch.md) - [Setting up a Batch from a Schema Dataset](https://docs.prolific.com/api-reference/ai-task-builder/setting-up-a-batch-from-a-schema-dataset.md) - [Configurable Layout](https://docs.prolific.com/api-reference/ai-task-builder/configurable-layout.md) - [Instructions](https://docs.prolific.com/api-reference/ai-task-builder/instructions.md) ## API Docs - AI Task Builder [List Batches](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-batches.md) - AI Task Builder [Create a Batch](https://docs.prolific.com/api-reference/ai-task-builder/create-task-builder-batch.md) - AI Task Builder [Get a Batch](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-batch.md) - AI Task Builder [Update a Batch](https://docs.prolific.com/api-reference/ai-task-builder/update-task-builder-batch.md) - AI Task Builder [Sync a Batch](https://docs.prolific.com/api-reference/ai-task-builder/sync-task-builder-batch.md) - AI Task Builder [Get Batch Sync Status](https://docs.prolific.com/api-reference/ai-task-builder/get-batch-sync-status.md) - AI Task Builder [Get Batch Status](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-batch-status.md) - AI Task Builder [Setup a Batch](https://docs.prolific.com/api-reference/ai-task-builder/setup-task-builder-batch.md) - AI Task Builder [Get Batch Responses](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-batch-task-responses.md) - AI Task Builder [Get Batch Report](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-batch-report.md) - AI Task Builder [Duplicate a Batch](https://docs.prolific.com/api-reference/ai-task-builder/duplicate-task-builder-batch.md) - AI Task Builder [List Batch Export Jobs](https://docs.prolific.com/api-reference/ai-task-builder/list-batch-export-jobs.md) - AI Task Builder [Request a Batch Export](https://docs.prolific.com/api-reference/ai-task-builder/request-batch-export.md) - AI Task Builder [Get Batch Export Status](https://docs.prolific.com/api-reference/ai-task-builder/get-batch-export-status.md) - AI Task Builder [Delete a Batch Export](https://docs.prolific.com/api-reference/ai-task-builder/delete-batch-export.md) - AI Task Builder [Create a Dataset](https://docs.prolific.com/api-reference/ai-task-builder/create-task-builder-dataset.md) - AI Task Builder [Get a Dataset](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-dataset.md) - AI Task Builder [Update a Dataset Schema](https://docs.prolific.com/api-reference/ai-task-builder/update-task-builder-dataset.md) - AI Task Builder [Get Dataset Upload URL](https://docs.prolific.com/api-reference/ai-task-builder/get-dataset-upload-url.md) - AI Task Builder [Get Dataset Import Status](https://docs.prolific.com/api-reference/ai-task-builder/get-dataset-import-status.md) - AI Task Builder [Append Datapoints to a Dataset](https://docs.prolific.com/api-reference/ai-task-builder/append-dataset-datapoints.md) - AI Task Builder [Get Schema Migration Status](https://docs.prolific.com/api-reference/ai-task-builder/get-schema-migration-status.md) - AI Task Builder [Get Dataset Status](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-dataset-status.md) - AI Task Builder [Get Batch Instructions](https://docs.prolific.com/api-reference/ai-task-builder/get-task-builder-instructions.md) - AI Task Builder [Create Batch Instructions](https://docs.prolific.com/api-reference/ai-task-builder/create-task-builder-instructions.md) - AI Task Builder [Update Batch Instructions](https://docs.prolific.com/api-reference/ai-task-builder/update-task-builder-instructions.md) - AI Task Builder [List Collections](https://docs.prolific.com/api-reference/ai-task-builder/list-collections.md) - AI Task Builder [Create a Collection](https://docs.prolific.com/api-reference/ai-task-builder/create-collection.md) - AI Task Builder [Get a Collection](https://docs.prolific.com/api-reference/ai-task-builder/get-collection.md) - AI Task Builder [Update a Collection](https://docs.prolific.com/api-reference/ai-task-builder/update-collection.md) - AI Task Builder [Get Collection Responses](https://docs.prolific.com/api-reference/ai-task-builder/get-collection-responses.md) - AI Task Builder [List Collection Export Jobs](https://docs.prolific.com/api-reference/ai-task-builder/list-collection-export-jobs.md) - AI Task Builder [Request a Collection Export](https://docs.prolific.com/api-reference/ai-task-builder/request-collection-export.md) - AI Task Builder [Get Collection Export Status](https://docs.prolific.com/api-reference/ai-task-builder/get-collection-export-status.md) - AI Task Builder [Delete a Collection Export](https://docs.prolific.com/api-reference/ai-task-builder/delete-collection-export.md) ## OpenAPI Specification The raw OpenAPI 3.1 specification for this API is available at: - [OpenAPI JSON](https://docs.prolific.com/api-reference/ai-task-builder/openapi.json) - [OpenAPI YAML](https://docs.prolific.com/api-reference/ai-task-builder/openapi.yaml)