Quick Start
require:
- docker
- docker-compose
docker network create vnet
# edit docker-compose.yml and run
# If you'd only like a websocket server, just set env: `JANUSGRAPH_TYPE=socket`.
docker-compose up -d
-
Notifications
You must be signed in to change notification settings - Fork 3
scil/docker-janusgraph-hbase
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
wait enough time and test
curl -XPOST -H content-type:application/json -d '{"gremlin":"g.V().values(\"name\")"}' http://localhost:8182
# response looks like :
# curl: (56) Recv failure: Connection reset by peer
# after enough time:
# {"requestId":"fd1abb80-7684-4a95-ae77-77c9c4b1be6d","status":{"message":"","code":200,"attributes":{"@type":"g:Map","@value":[]}},"result":{"data":{"@type":"g:List","@value":[]},"meta":{"@type":"g:Map","@value":[]}}}
use local janusgraph instead of service janusgraph
docker-compose stop janusgraph
# edit hosts
./update_hosts.sh
$JANUSGRAPH_LOC=/vagrant/vendors/janusgraph-0.3.1-hadoop2
# first edit then run
vi ./config_local_janusgraph.sh
$JANUSGRAPH_LOC/bin/gremlin-server.sh $JANUSGRAPH_LOC/conf/gremlin-server/${JANUSGRAPH_TYPE}-hbase -es-server.yaml
use gremlin-python? see python
Step by Step
1. build
build gremlin-server
docker image build -t scil/janusgraph .
build console
docker image build -t scil/janusgraph-console . --build-arg console=true
2. edit run.sh and execute it
./run.sh
two hosts must be given
--add-host hbase-server:192.168.1.110
--add-host es-server:192.168.1.111
192.168.1.111 is where you elasticsearch server , ensure network.host: 0.0.0.0 in elasticsearch.yml
If can download janusgraph-${JANUSGRAPH_VERSION}-hadoop2.zip to here, otherwise Dockerfile will use wget.
You can also use -v :/home/janusgraph/janusgraph/conf/gremlin-server to use your own conf files for the JanusGraph server. The following files are used by JanusGraph Server in that directory:
janusgraph-hbase-es-server.properties
socket-hbase-es-server.yaml
http-hbase-es-server.yaml
log4j-server.properties
If you need to adjust the java heap size for the JanusGraph Server Java process, you can use -e to specify the JAVA_OPTIONS like this:
-e "JAVA_OPTIONS=-Xms2048m -Xmx2048m"
This will assign 2GB for the java heap.
Thanks to https://hub.docker.com/r/yihongwang/janusgraph-server/ which is about janusgraph and cassandra (not hbase)
3. docker compose
use docker-compose.yml produced by docker-hbase and run
docker-compose up janusgraph -d
or
docker-compose start janusgraph
Choice 1 : use janusgraph as a service
janusgraph:
container_name: janusgraph
networks: ["vnet"]
hostname: janusgraph
links:
- "zookeeper-1:hbase-server"
extra_hosts:
# - "hbase-server:172.18.x.xxx"
- "es-server:192.168.1.111"
depends_on:
zookeeper-1:
elasticsearch:
- condition: service_healthy
volumes:
- /vagrant/vendors/janusgraph-0.3.1-hadoop2/conf/gremlin-server:/home/janusgraph/janusgraph/conf/gremlin-server
image: scil/janusgraph:latest
ports: ["8182:8182"]
environment:
- JANUSGRAPH_TYPE=http
- JANUSGRAPH_VERSION=0.3.1
192.168.1.111 is where you elasticsearch server , ensure network.host: 0.0.0.0 in elasticsearch.yml and vm.max_map_count=655360 in /etc/sysctl.conf.
Choice 2 : use elasticsearch as a service
See docker-compose.yml.
Thanks to janusgraph-dist-hadoop-2/docker-compose
4. test
test elasticsearch
curl http://localhost:9200
test gremlin.sh
graph = JanusGraphFactory.open('conf/janusgraph-hbase-es.properties')
# put some data into graph
GraphOfTheGodsFactory.load(graph)
g = graph.traversal()
saturn = g.V().has('name', 'saturn').next()
g.V(saturn).valueMap()
test http (ENV JANUSGRAPH_TYPE=http)
curl -XPOST -Hcontent-type:application/json -d '{"gremlin":"g.V().values(\"name\")"}' http://localhost:8182
test socket( ENV JANUSGRAPH_TYPE=socket, or both)
# bin/gremlin.sh
# https://docs.janusgraph.org/0.3.1/server.html
:remote connect tinkerpop.server conf/remote.yaml session
:> g.V().values('name')
If something goes wrong
#ensure /etc/hosts is right if using local janusgraph instead of service janusgraph
tail /etc/hosts | grep vnet && echo real IPs: && echo `docker inspect -f '{{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' hmaster-1 ` hmaster-1 && echo `docker inspect -f '{{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' regionserver-1` regionserver-1 && echo `docker inspect -f '{{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' zookeeper-1` zookeeper-1
docker-compose ps
docker logs [service-name]
Try docker-compose down && docker-compose up -d How to rebuild docker container in docker-compose.yml?
if logs contain
regionserver-1 | 2018-11-02 08:28:22,414 WARN [regionserver/regionserver-1.vnet/172.18.0.7:16020.logRoller ] wal.FSHLog: Too many consecutive RollWriter requests, it's a sign of the total number of live datanodes is lower than the tolerable replicas.