7. [Known issues, caveats and troubleshooting](#issues)

8. [Future plans](#future)

*Please have a quick look over the [Known issues, caveats and troubleshooting](#issues) section before using the app.*

<a name="what"></a>

* It is **completely automatic**, provide a path with hundereds of csvs having size in gigabytes and start the application, it will handle the rest!

* While you can have maximum utilization of your cpu to get execellent performance, csv2sql is fully **customizable**, also comes with [lots of options](#cmdargs) which can be changed to fine tune the application based on requirement and to lower down resource usage and database load.

* Csv2Sql supports **partial operations**, so if you only want to generate a schema file from the csvs without touching the database or you want to only insert data from the csvs into already created tables without creating the tables again or just validate already imported data, Csv2Sql has got you covere !

<a name="cmd"></a>

Csv2sql can be easily used as a command line tool, with lots of customizable options passing by different command line arguments.

<p align="center">

<img src="https://raw.githubusercontent.com/Arp-G/csv2sql/master/.github/images/cmd.gif"

alt="command line app demo"/>

</p>

<a name="cmdinstall"></a>

and run the executable using: ```./csv2sql --<argument>```

The next section describes all the avialable command line arguments.

A description of all the available command line arguments that can be used are given below:

| Flag | Description | Default value |

|:-----------:|----------------------|------|

| \-\-schema-file-path | The location were the generated schema file will be stored | If no value is supplied it saves the generated schema file in the same directory as the source csv files specified by "\-\-source-csv-directory" flag |

| \-\-pool-size | The pool_size controls how many connections you want to the database. | 20 |

| \-\-queue-target | The time to wait for a database connection | 5000 |

| \-\-queue-interval | If all connections checked out during a :queue_interval takes more than :queue_target, then we double the :queue_target. | 1000 |

<a name="cmdexamples"></a>

`./csv2sql --skip-make-schema --skip-insert-data --imported-csv-directory "/home/user/Desktop/imported-csvs" --db-connection-string "mysql:root:pass@localhost/test_csv"`

Here we are running simple validation check over a previously imported csvs, this check will NOT compare the actual data but will only compare the row count in the csv and in the database.

<a name="dashboard"></a>

For ease of use csv2sql also has a browser interface which can be used to easily configure the tool and also provides and execent interface that shows what is the progress of the various running tasks, which files are currently being processed, the current cpu and memory usage, etc.

Whenever your are done, click on the `Start` tab and click on `Start` button below to start the import process.

<a name="sourceinstall"></a>

You must have elixir and mysql/postgresql installed in your system to run Csv2Sql.

by `mix deps.get`

Finally, start the application by ```mix phx.server```

Thats all !

<a name="support"></a>

Csv2sql currently supports [MySql](https://www.mysql.com/) and [PostgreSQL](https://www.postgresql.org/) database.

| text | TEXT | TEXT |

All other types of data, will map to either VARCHAR or TEXT.

<a name="issues"></a>

* Csvsql uses the csv file names as table names, make sure that the csv file names are valid table names.

* Make sure your csvs have correct encoding and valid column names to avoid errors.(like a csv having duplicated column names will lead to errors when inserting in to the database).

* If you face database connection timeout errors try reducing the worker and db_worker count in the configurations or change the database timeout, pool size and other related database configurations.

* In case of errors, check your terminal for a clue, or create an issue.

}

.toggle-configs {

}

.toggle-config-item {

}

.legend-heading, .toggle-config-heading {

font-weight: bold;

font-style: italic;

}

.legend{

flex-direction: column;

margin: 30px;

border-radius: 6px;

box-shadow: 0 2px 5px rgba(201,209,230,.5), 0 7px 20px rgba(201,209,230,.75);

background-color: #fff;

padding: 1rem;

}

.legend-item{

}

.legend-color-item{

right: 10px;

width: 20px;

height: 20px;