presto-gateway 试用以及docker 镜像制作

presto-gateway 是 lyft 团队开源的prestodb 的工具.以下是一个简单的试用，以及碰到问题的解决
还有就是docker 镜像的制作

Dockerfile

很简单，本地构建然后基于jdk 基础镜像，制作docker 镜像

git clone https://github.com/rongfengliang/presto-gateway.git

cd presto-gateway

mvn clean pacakge

FROM azul/zulu-openjdk-alpine:8u222

LABEL AUTHOR="dalongrong"

LABEL EMAIL="1141591465@qq.com"

LABEL VERSION="1.6.1"

WORKDIR /

COPY gateway/target/gateway-1.6.1-jar-with-dependencies.jar /gateway.jar

COPY config.yml.template /config.yml.template

COPY entrtypoint.sh /entrtypoint.sh

RUN chmod +x /entrtypoint.sh

EXPOSE 8888

ENTRYPOINT [ "/entrtypoint.sh"]

version: "3"

services:

  proxy:

     image: dalongrong/presto-gateway:1.6.1

     ports:

     - "8888:8888"

     - "8082:8082"

     - "8083:8083"

     build: ./

     volumes:

     - "./config.yml.template:/config.yml.template"

  presto1:

     image: starburstdata/presto

     ports:

     - "8080:8080"

  presto2:

     image: starburstdata/presto

     ports:

     - "8081:8080"

requestRouter:

  port: 8888

  name: prestoRouter

  cacheDir: /var/log/prestoproxy/cache

  historySize: 1000

backends:

  - localPort: 8082

    name: presto1

    proxyTo: http://presto1:8080

    routingGroup: adhoc

  - localPort: 8083

    name: presto2

    proxyTo: http://presto2:8080

    routingGroup: scheduled

server:

  applicationConnectors:

    - type: http

      port: 8090

  adminConnectors:

    - type: http

      port: 8091

notifier:

  smtpHost: localhost

  smtpPort: 587

  sender: presto-gw-monitor-noreply@lyft.com

  recipients:

    - prestodev@yourorg.com

modules:

  - com.lyft.data.gateway.module.ProxyBackendProviderModule

  - com.lyft.data.gateway.module.GatewayProviderModule

  - com.lyft.data.gateway.module.NotifierModule

managedApps:

  - com.lyft.data.gateway.GatewayManagedApp

  - com.lyft.data.gateway.ActiveClusterMonitor

# Logging settings.

logging:

  # The default level of all loggers. Can be OFF, ERROR, WARN, INFO, DEBUG, TRACE, or ALL.

  level: INFO

  # Logger-specific levels.

  loggers:

    com.lyft: DEBUG

  appenders:

    - type: console

    - type: file

      currentLogFilename: /var/log/prestoproxy/prestoproxy-java.log

      archivedLogFilenamePattern: /var/log/prestoproxy/prestoproxy-java-%d{yyyy-MM-dd}-%i.log.gz

      archivedFileCount: 7

      timeZone: UTC

      maxFileSize: 100MB

为了使用方便，修改了一现有nodejs 的presto client 支持presto-gateway

var presto = require('@dalongrong/presto-client');

var client = new presto.Client({

  user: 'appdemo',

  host: "localhost",

  port: 8888

});

client.execute({

  query: 'select * from nation2',

  catalog: 'memory',

  schema: 'default',

  source: 'nodejs-client',

  routingGroup: 'scheduled',

  state: function (error, query_id, stats) {

    console.log(error)

    console.log({

      message: "status changed",

      id: query_id,

      stats: stats

});

},

  columns: function (error, data) {

    console.log({

      resultColumns: data

});

},

  data: function (error, data, columns, stats) {

    console.log(data);

},

  success: function (error, stats) {

    console.log(stats)

},

  error: function (error) {

    console.log(error)

});

对于使用可以参考官方文档，官方的截图目前有点问题，但是presto-gateway是一个很不错的工具，可以简化我们对于presto 的管理