csvsplit

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

★ 9 Open GitHub ↗

Split CSV into multiples files base on value of a specified column.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# CSV Split

[![npm version](https://img.shields.io/npm/v/@aleung/csvsplit.svg?maxAge=2592000)](https://www.npmjs.com/package/@aleung/csvsplit)

CLI utility to split CSV into multiples files base on value of a specified column.

## Feature

You have one or more data sheets. You want to split data into files and each one groups the records which have same value in a column.

> input.csv

| id | name | group |
|----|------|-------|
| 1  | Alice | A    |
| 2  | Bob   | B    |
| 3  | Charley | A  |
| 4  | David | B     |

Being processed with __csvsplit__, base on value of column `group`, it becomes:

> A.csv

| id | name | group |
|----|------|-------|
| 1  | Alice | A    |
| 3  | Charley | A  |

> B.csv

| id | name | group |
|----|------|-------|
| 2  | Bob   | B    |
| 4  | David | B    |

It's able to process multiple input files. No need to combile them beforehead.

## Install

This tool runs on node.js execution environment. If node.js hasn't been
installed on your OS, download from [Node.js official site](https://nodejs.org/en/download/current/)
and install it.

On command line, type `node --version` to make sure node.js has been
installed properly. Node.js v12.0 or higher is required.

Install CSV split:

npm install -g @aleung/csvsplit

It runs on any OS platform that node.js supports.

You could run CSV split without installation by adding `npx` before the command:

npx @aleung/csvsplit --help

## Usage

```
$ csvsplit --help
Usage: csvsplit [options] <inputfiles>

Options:
  -c, --column  The index of column base which to split (A=1, B=2 ...)             [number] [required]
  -f, --filter  If set, only when the column value is in this list will be outputed. Configure with a
                comma seperated list of values.                                               [string]
  -o, --output  Directory to put generated files into                         [string] [default: "./"]
  --no-header  The input CSV file has no header                             [boolean] [default: false]
  --help        Show help                                                                    [boolean]

Examples:
  csvsplit -c 2 -o ./output ./input/*.csv       Process all CSV files and split base on the 2nd column
```

The generated csv files are named into the value of the column base on which to split.

There might be an extra csv file generated, in which contains only the header.
Just delete it.

If you get "Too many open files" issue, try to use `--filter` option to limit the number of generated files.

## Development

```
$ yarn install
$ yarn test
```

## Similar Project

[xsv](https://github.com/BurntSushi/xsv): A fast CSV command line toolkit written in Rust.

csvsplit

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README