Skip to content
This repository was archived by the owner on May 12, 2021. It is now read-only.

Comments

TAJO-2148: Implement an example HTTP tablespace#1034

Closed
jihoonson wants to merge 5 commits intoapache:masterfrom
jihoonson:TAJO-2148
Closed

TAJO-2148: Implement an example HTTP tablespace#1034
jihoonson wants to merge 5 commits intoapache:masterfrom
jihoonson:TAJO-2148

Conversation

@jihoonson
Copy link
Contributor

You can test like below.

default> create table github (*) tablespace http_example using ex_http_json with ('path'='2015-01-01-15.json.gz');
OK
default> \d github

table name: default.github
table uri: http://data.githubarchive.org/2015-01-01-15.json.gz
store type: ex_http_json
Options:
    'path'='2015-01-01-15.json.gz'
    'timezone'='Asia/Seoul'

schema: 


default> select type, repo.name, count(*) from github group by type, repo.name;
[=========================================>] 100%  5.98 sec
type,  repo/name,  ?count
-------------------------------
IssuesEvent,  vispy/vispy,  1
PushEvent,  haraldsk/puppet-module-nfs,  2
DeleteEvent,  peterzd/buddy-pix,  1
PushEvent,  jgsme/dev,  3
...

@jihoonson jihoonson changed the title TAJO-2148: Implement an example HTTP tablespace. TAJO-2148: Implement an example HTTP tablespace May 31, 2016
@jihoonson
Copy link
Contributor Author

I disabled the example http tablespace for http scheme by default because it is not proper for real appliactions, and thus users need to implement their own tablespace for the real applications.
To use this example tablespace, just add the following lines to storage-site.json.

"http": {
      "handler": "org.apache.tajo.storage.http.ExampleHttpFileTablespace",
      "default-format": "json"
    }

@jinossy
Copy link
Member

jinossy commented Jun 28, 2016

+1 Looks great to me
Would you add a document to wiki for a developer?

@jihoonson
Copy link
Contributor Author

@jinossy, thank you for your review. I'll add a document to wiki.

@asfgit asfgit closed this in 4d2bd64 Jun 28, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants