Dataset annotation guideline

Writes annotation guidelines that two annotators can apply consistently.

For labeled-data projects — sentiment, classification, NER.

AI / MLannotationdata

The prompt

Copy this into ChatGPT, Claude, Gemini or any assistant you already use — then paste your own task + label types underneath it.

Write annotation guidelines. Sections:

**Goal** (what label is, why it matters)
**Labels** (each: name, definition, 3 positive examples, 3 negative)
**Edge cases** (5-10 — when ambiguous, what to pick + why)
**Tie-breakers** (rules to resolve disagreements)
**What NOT to label**
**Time per example** (target)
**Quality checks** (sampling, inter-annotator agreement target)

Rules:
- Every label needs examples + counter-examples.
- Edge cases must be specific.

Or run it here

Task + label types

0/8000

Output

Output will appear here after you click Run.

Or run in your favourite chatbot

Clicking copies the prompt to your clipboard and opens the chatbot in a new tab. Gemini doesn't accept URL params — paste manually with Ctrl/Cmd+V.

Fine-tune ground truth template

Builds a JSON template + 10 sample I/O pairs for a fine-tuning dataset.

Improve my prompt

Takes a vague prompt and rewrites it to be specific, structured, and reliable.

LLM eval rubric

Builds a structured eval rubric to grade LLM outputs for a specific task.

Chain-of-thought reasoning prompt

A system prompt template that pushes the model to show its reasoning before answering.

Model card draft

Drafts a model card with intended use, limitations, training data summary, evaluation results.

RAG retrieval prompt

Designs a system prompt that turns user questions into retrieval queries — multi-query, HyDE, etc.

Browse the full free AI prompt library or see more ai / ml prompts.