Attention sink

An attention sink — the first token soaks up the attention that has nowhere else to go

Category: AI & LLM
Group: inference
Added: 0.6.3
Licence: MIT

outline · regular · 2.0024px

import { AttentionSink } from "@iconmind/react";

<AttentionSink />

See it in action

outline · 2.00

Buttons16px

Run attention sinkSecondary

Ghost

Sidebar18px

Workspace

Attention sink12AblationAccuracyActivation

Toolbar16px · in a row

Attention sink

OverviewRunsLogs

Knocked out16 · 20px

Attention sink

attention-sink

Run

4 running

A list20px

Attention sink

Updated 4 minutes ago

active

Accuracy

Idle since Tuesday

idle

Activation

Idle since Tuesday

idle

A metric20px · beside a number

+12.4%

1,284

Attention sink events this week

Icons that go with Attention sink

The concepts this one usually appears beside, not just the ones filed near it.

cross-encoder key donate cost-explorer mcp-client revenue-goal

More AI & LLM icons

300 icons across 10 groups, drawn to the same grid and the same stroke.

See all 300 →

ablation accuracy activation adapter add-checkpoint alignment attention attention-head attention-mask audio-denoise audio-gen audio-model base-model batch-inference beam-search benchmark best-of-n bias

Improve this icon on GitHub

Ship Attention sink in your next build

Attention sink is one of 2,437 icons compiled from a single grid — outline and duotone, three weights, every cell generated rather than redrawn. MIT licensed: commercial use, no attribution, no seat count.

Browse AI & LLM Install the package Request an icon