# storage-connector

**Repository Path**: Devil666/storage-connector

## Basic Information

- **Project Name**: storage-connector
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2021-08-02
- **Last Updated**: 2021-08-05

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Trino Storage Connector 
[![Build Status](https://github.com/ebyhr/trino-storage/workflows/CI/badge.svg)](https://github.com/ebyhr/trino-storage/actions?query=workflow%3ACI+event%3Apush+branch%3Amaster)
This is a [Trino](http://trino.io/) connector to access local file (e.g. csv, tsv). Please keep in mind that this is not production ready and it was created for tests.

# Query
You need to specify file type by schema name and use absolute path.
```sql
select
  * 
from 
 storage.csv."file:///tmp/numbers-2.csv"
;

select
  * 
from 
 storage.csv."https://raw.githubusercontent.com/ebyhr/trino-storage/master/src/test/resources/example-data/numbers-2.csv"
;
``` 

Supported schemas are below.
- `tsv`
- `csv`
- `txt`
- `raw`
- `excel`

`tsv` plugin extract each line with `\t` delimiter. Currently first line is used as column names.
```sql
select * from storage.tsv."https://raw.githubusercontent.com/ebyhr/trino-storage/master/src/test/resources/example-data/numbers.tsv";
``` 
```
  one  | 1 
-------+---
 two   | 2 
 three | 3
(2 rows)
```


`csv` plugin extract each line with `,` delimiter. Currently first line is used as column names.
```sql
select * from storage.csv."https://raw.githubusercontent.com/ebyhr/trino-storage/master/src/test/resources/example-data/numbers-2.csv";
```
```
  ten   | 10 
--------+----
 eleven | 11 
 twelve | 12
(2 rows)
```

`txt` plugin doesn't extract each line. Currently column name is always `value`.
```sql
select * from storage.txt."https://raw.githubusercontent.com/ebyhr/trino-storage/master/src/test/resources/example-data/numbers.tsv";
``` 
```
 value  
--------
 one    1   
 two    2   
 three  3
(3 rows)
```

`raw` plugin doesn't extract each line. Currently column name is always `data`. This connector is similar to `txt` plugin. 
The main difference is `txt` plugin may return multiple rows, but `raw` plugin always return only one row.
```sql
select * from storage.raw."https://raw.githubusercontent.com/ebyhr/trino-storage/master/src/test/resources/example-data/numbers.tsv";
``` 
```
  data  
--------
 one    1   
 two    2   
 three  3 
(1 row)
```

`excel` plugin currently read first sheet.
```sql
select * from storage.excel."https://raw.githubusercontent.com/ebyhr/trino-storage/master/src/test/resources/example-data/sample.xlsx";
``` 
```
  data  
--------
 one    1   
 two    2   
 three  3 
(1 row)
```

# Build
Run all the unit test classes.
```
mvn test
```

Creates a deployable jar file
```
mvn clean compile package
```

Copy jar files in target directory to use storage connector in your Trino cluster.
```
cp -p target/*.jar ${PLUGIN_DIRECTORY}/storage/
```