Grafana分析Nginx日志

按日期对ES的index进行分割:

logstash配置:

input{

  file{

    path => "/home/hottopic/logs/trend-shotting-api/metric/*"

    type => "trend-shotting-api-metric"

    start_position => "beginning"

    codec => json {

            charset => "UTF-8"

        }

  }

}

output{

  if [type] == "trend-shotting-api-metric" {

    elasticsearch {

    hosts=> ["172.17.213.60:9200"]

    index=> "trend-shotting-api-metrick.%{+YYYY-MM}"

    }

  }

}

grafana源配置：(注意日期格式要统一，比如YYYY-MM或YYYY.MM)

配置Groub by -Terms时报错，提示需要设置fielddata=true，报错内容大概如下：

"Fielddata is disabled on text fields by default ... "

解决方法如下：

https://www.elastic.co/guide/en/elasticsearch/reference/current/fielddata.html#_fielddata_is_disabled_on_literal_text_literal_fields_by_default

curl -X PUT "localhost:9200/nginx/_mapping/doc" -H 'Content-Type: application/json' -d'

{

  "properties": {

    "xforward": {

      "type":     "text",

      "fielddata": true

    }

  }

}

'

操作后仍然报错，于是

curl -X PUT "localhost:9200/nginx/_mapping/doc?update_all_types" -H 'Content-Type: application/json' -d'

{

  "properties": {

    "xforward": {

      "type":     "text",

      "fielddata": true

    }

  }

}

'

以上nginx为index名称 xforward为字段名称。

修改完后查看结果显示已修改成功

返回到Grafana进行再一次设置

修改成功后，可以正常出图。

巴特西

Grafana分析Nginx日志

最新文章

热门文章