sort -u my_mega_list.txt -o my_clean_list.txt
Your wordlists are only as good as the latest vulnerabilities. If you used Git, updating is trivial:
cd /usr/share/wordlists/SecLists/
sudo git pull
Warning: git pull on a shallow clone (--depth 1) can sometimes fail. If it does, simply re-clone: installing seclists
cd /usr/share/wordlists/
sudo rm -rf SecLists/
sudo git clone --depth 1 https://github.com/danielmiessler/SecLists.git
If you used the APT method on Kali:
sudo apt update && sudo apt upgrade seclists
The legendary rockyou list is often gzipped in SecLists. Unzip it: sort -u my_mega_list
gunzip /usr/share/seclists/Passwords/Leaked-Databases/rockyou.txt.gz
Once you have mastered installing SecLists, you might want to create your own aggregate lists. Your wordlists are only as good as the