Remove Duplicate Lines
Remove duplicate lines from a list or block of text, keeping the first occurrence of each. Free and private, right in your browser.
Paste in a list, log, or export and get back only the unique lines, in the order they first appeared. Handy for cleaning up email lists, merged CSV columns, log files, or any text where copy-pasting from multiple sources left you with repeats.
How to use it
- Paste or type your text into the box
- Choose whether matching should be case-sensitive and whether to trim whitespace
- Copy or download the deduplicated result
Frequently asked questions
- Does it keep the first occurrence or the last?
- The first occurrence of each line is kept, and everything else is removed. Order is otherwise preserved, so your list doesn't get shuffled.
- Will "Apple" and "apple" count as duplicates?
- Only if you turn on case-insensitive matching. By default matching is case-sensitive, so differently-cased lines are treated as distinct.
- What happens to blank lines and extra spaces?
- Blank lines are treated like any other line (repeats get collapsed to one), and there's a trim-whitespace option if you want "foo " and "foo" to count as the same line.
- Is my text uploaded anywhere?
- No. Everything runs locally in your browser, so nothing you paste ever leaves your machine.
- 1
Nothing is uploaded
The file never leaves your device. There is no server to send it to, so there is nothing to leak, log, or subpoena.
- 2
No signup, no limits
No account, no email, no daily cap, no watermark, and no paid tier waiting behind the third file.
- 3
Works offline
Load the page once and it keeps working with the network off, because all the work was always happening locally.