Teadmistebaas

  1. Portaali avaleht
  2. Teadmistebaas
  3. Scripts
  4. Linux - Delete lines with duplicate data

Linux - Delete lines with duplicate data

If for example you dont want the same email address to be in your .csv files you would run the following command to
awk '!x[$2]++' FS="," FILENAME.csv > newname.csv

FILENAME.csv needs to be replaced with your .csv file and [$2] needs to be edited to represent the line you want to check for duplicate content.

Kas see vastus oli kasulik?

 Prindi artikkel

Loe veel

Linux - How to delete .csv file containing "X" data

After extracting the .csv.gz files you can delete certain unwanted data by running the following...

Linux - How to extract .gz files (gunzip)

For this guide we will be using gunzip. You may need to installed it.CentOS - yum install gunzip...

Linux - Delete .csv column

Before you start you need to install Ubuntu - sudo apt-get install libtext-csv-perl CentOs -...

Linux - How to only keep X data

Firstly to start this you need to convert your .csv into a .txt mv filename.csv  filename.txt...

Linux - Download files through FTP

To download all files recursively run the following command. wget -nc -np --reject "index.html*"...