Cleanup
Duplicate Line Remover
Use this on lists, logs, and keyword sets. The first copy of a line stays, later copies go, and the order of the remaining lines does not change. Blank lines can stay so paragraphs do not collapse.
This draft stays in the tab. Opening a file reads it here and does not upload it.
Lines kept
0 duplicate lines removed.
How to use it
- Paste one entry per line, or open a text file. The file is not uploaded.
- Turn on Ignore case when Email and email should count as the same line.
- Copy the result. The note above it says how many lines were removed.
Example
index.html styles.css index.html styles.css app.ts
index.html and styles.css each remain once. The blank line stays because Keep blank lines is on.
Questions
Which copy is kept?
The first one, with its original spacing if you are not trimming. Later copies are removed.
Does trimming change the text that is kept?
Trimming is used only to decide what counts as a duplicate. The kept line is the original first line, including its spaces.
What if the whole file is one paragraph?
Lines are split on newline characters. A paragraph with no line breaks is a single line, so there is nothing to dedupe until you break it up.