Skip to content

vasaristudio/vagrant-hbase

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

54 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

vagrant-hbase

Vagrantfile for quick-and-dirty HBase setup.

Overview

This Vagrant project sets up a Ubuntu 12.04 (precise) virtual machine and provisions it for HBase development. Ansible is used for VM provisioning.

After running vagrant up, a single HBase node is set up in standalone mode (using local file system, not HDFS). A Thrift server is also running, allowing access from languages outside of the JVM.

Getting started

  1. install Ansible on your host machine
  2. git clone https://github.com/zsiciarz/vagrant-hbase.git && cd vagrant-hbase && vagrant up
  3. ????
  4. PROFIT!

Note: Ansible < 1.2 may not work due to some bugs in parsing Jinja2 syntax in playbooks. Ubuntu 13.04 has only Ansible 1.1 in repositories, therefore it's best to use sudo pip install ansible to get a more recent version.

Network and ports

The guest machine has a private IP address 192.168.15.166. HBase-related ports are forwarded according to the following rule:

hostPortNumber = guestPortNumber + 100

For example, HBase web UIs are available from the host machine at http://127.0.0.1:60110 (Master) and http://127.0.0.1:60130 (RegionServer).

Initial data

The create_test_table.rb file can be loaded into HBase shell to define a dead simple test table with one column family cf. The table looks like this:

+--------+-----------+
| rowkey |  cf:col1  |
+--------+-----------+
|  row1  |   value1  |
+--------+-----------+

To load the data, execute:

vagrant ssh
cd hbase-0.94.9/
./bin/hbase shell /vagrant/data/create_test_table.rb

Jython

A Jython interpreter is also installed in the VM. To access Java HBase API from Jython, you need to set the CLASSPATH environment variable correctly. HBase CLI tool can help in that matter.

vagrant ssh
cd hbase-0.94.9/
export CLASSPATH=`./bin/hbase classpath`
jython

This should drop you into Jython REPL where you can import Java classes and use them in a more Pythonic way. An example script that reads the data loaded with create_test_table.rb is at /vagrant/test.py.

Python and HappyBase

An alternative approach to access HBase from Python is to use a regular (CPython) interpreter and Thrift bindings. A Python library called HappyBase hides away all the necessary plumbing behind a simple, clean interface to your data. For your convenience, this package is installed into system-wide Python libraries when provisioning the guest machine.

An example Python session on the guest machine may look like this (assuming initial data were loaded):

vagrant@vagrant-hbase:~$ python
Python 2.7.3 (default, Apr 10 2013, 05:46:21)
[GCC 4.6.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import happybase
>>> conn = happybase.Connection()
>>> print conn.tables()
['test']
>>> table = conn.table('test')
>>> print table.row('row1')
{'cf:col1': 'value1'}

Author

  • Zbigniew Siciarz (zbigniew at siciarz dot net)

License

This work is released under the MIT license. A copy of the license is provided in the LICENSE file.

About

Vagrantfile for quick-and-dirty HBase setup.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published