Organize multi-line lists, remove blank lines and duplicate items
Organize multi-line lists, remove blank lines and duplicate items: purpose and instructions
Paste a list of supplier names, items or codes. Remove leading and trailing whitespace, blank lines and exact duplicates while retaining the order of first appearance. Review the original list, cleaned result and removed counts, then copy or download plain text. Processing stays in this browser page; nothing is automatically saved or uploaded.
How to use
Paste the original list, with one item per line; you can also load the example to see how it is organized.
Check the compiled list and the number of transactions, and confirm the removed blank lines and duplicate items.
Copy the compiled list or download a TXT text file; the original input will not be overwritten by the result.
Frequently asked questions
What content is considered a duplicate?
After removing the leading and trailing blanks of each line, the entire line of text will be duplicated only if it is exactly the same, and the position of the first occurrence will be retained. Upper and lower case, all half-forms, leading zeros and spaces in the middle of text will be preserved. For example, 001 and 1, ABC and abc will not be merged; it will not be guessed whether different company names belong to the same company.
How much data can be sorted? Will it parse a spreadsheet or CSV?
Maximum of 100,000 characters and 5,000 original lines at a time, including blank lines. If the upper limit is exceeded, a modification will be prompted and no truncated results will be output. The tool only sorts plain text line by line; it does not parse CSV fields, quotes, or values, or rewrite the original input.