telegraf/plugins/inputs/leofs
Yosuke Hara 7f1e4c847f Add support for LeoFS v1.4 to leofs input (#4044) 2018-04-24 14:14:31 -07:00
..
README.md Add support for LeoFS v1.4 to leofs input (#4044) 2018-04-24 14:14:31 -07:00
leofs.go Add support for LeoFS v1.4 to leofs input (#4044) 2018-04-24 14:14:31 -07:00
leofs_test.go Add support for LeoFS v1.4 to leofs input (#4044) 2018-04-24 14:14:31 -07:00

README.md

LeoFS Input Plugin

The LeoFS plugin gathers metrics of LeoGateway, LeoManager, and LeoStorage using SNMP. See LeoFS Documentation / System Administration / System Monitoring.

Configuration:

# Sample Config:

[[inputs.leofs]]
        servers = ["127.0.0.1:4010"]

Measurements & Fields:

Statistics specific to the internals of LeoManager

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Statistics specific to the internals of LeoStorage

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Total Number of Requests

  • 1 min Statistics
    • num_of_writes
    • num_of_reads
    • num_of_deletes
  • 5 min Statistics
    • num_of_writes_5min
    • num_of_reads_5min
    • num_of_deletes_5min

Total Number of Objects and Total Size of Objects

  • num_of_active_objects
  • total_objects
  • total_size_of_active_objects
  • total_size

Total Number of MQ Messages

  • num_of_replication_messages,
  • num_of_sync-vnode_messages,
  • num_of_rebalance_messages,
  • mq_num_of_msg_recovery_node
  • mq_num_of_msg_deletion_dir
  • mq_num_of_msg_async_deletion_dir
  • mq_num_of_msg_req_deletion_dir
  • mq_mdcr_num_of_msg_req_comp_metadata
  • mq_mdcr_num_of_msg_req_sync_obj

Note: The following items are available since LeoFS v1.4.0:

  • mq_num_of_msg_recovery_node
  • mq_num_of_msg_deletion_dir
  • mq_num_of_msg_async_deletion_dir
  • mq_num_of_msg_req_deletion_dir
  • mq_mdcr_num_of_msg_req_comp_metadata
  • mq_mdcr_num_of_msg_req_sync_obj

Data Compaction

  • comp_state
  • comp_last_start_datetime
  • comp_last_end_datetime
  • comp_num_of_pending_targets
  • comp_num_of_ongoing_targets
  • comp_num_of_out_of_targets

Note: The all items are available since LeoFS v1.4.0.

Statistics specific to the internals of LeoGateway

Erlang VM

  • 1 min Statistics
    • num_of_processes
    • total_memory_usage
    • system_memory_usage
    • processes_memory_usage
    • ets_memory_usage
    • used_allocated_memory
    • allocated_memory
  • 5 min Statistics
    • num_of_processes_5min
    • total_memory_usage_5min
    • system_memory_usage_5min
    • processes_memory_usage_5min
    • ets_memory_usage_5min
    • used_allocated_memory_5min
    • allocated_memory_5min

Total Number of Requests

  • 1 min Statistics
    • num_of_writes
    • num_of_reads
    • num_of_deletes
  • 5 min Statistics
    • num_of_writes_5min
    • num_of_reads_5min
    • num_of_deletes_5min

Object Cache

  • count_of_cache-hit
  • count_of_cache-miss
  • total_of_files
  • total_cached_size

Tags:

All measurements have the following tags:

  • node

Example output:

LeoManager

$ ./telegraf --config ./plugins/inputs/leofs/leo_manager.conf --input-filter leofs --test
> leofs, host=manager_0, node=manager_0@127.0.0.1
  allocated_memory=78255445,
  allocated_memory_5min=78159025,
  ets_memory_usage=4611900,
  ets_memory_usage_5min=4632599,
  num_of_processes=223,
  num_of_processes_5min=223,
  processes_memory_usage=20201316,
  processes_memory_usage_5min=20186559,
  system_memory_usage=37172701,
  system_memory_usage_5min=37189213,
  total_memory_usage=57373373,
  total_memory_usage_5min=57374653,
  used_allocated_memory=67,
  used_allocated_memory_5min=67
  1524105758000000000

LeoStorage

$ ./telegraf --config ./plugins/inputs/leofs/leo_storage.conf --input-filter leofs --test
> leofs,host=storage_0,node=storage_0@127.0.0.1
  allocated_memory=63504384,
  allocated_memory_5min=0,
  comp_last_end_datetime=0,
  comp_last_start_datetime=0,
  comp_num_of_ongoing_targets=0,
  comp_num_of_out_of_targets=0,
  comp_num_of_pending_targets=8,
  comp_state=0,
  ets_memory_usage=3877824,
  ets_memory_usage_5min=0,
  mq_mdcr_num_of_msg_req_comp_metadata=0,
  mq_mdcr_num_of_msg_req_sync_obj=0,
  mq_num_of_msg_async_deletion_dir=0,
  mq_num_of_msg_deletion_dir=0,
  mq_num_of_msg_recovery_node=0,
  mq_num_of_msg_req_deletion_dir=0,
  num_of_active_objects=70,
  num_of_deletes=0,
  num_of_deletes_5min=0,
  num_of_processes=577,
  num_of_processes_5min=0,
  num_of_reads=1,
  num_of_reads_5min=0,
  num_of_rebalance_messages=0,
  num_of_replication_messages=0,
  num_of_sync-vnode_messages=0,
  num_of_writes=70,
  num_of_writes_5min=0,
  processes_memory_usage=20029464,
  processes_memory_usage_5min=0,
  system_memory_usage=25900472,
  system_memory_usage_5min=0,
  total_memory_usage=45920987,
  total_memory_usage_5min=0,
  total_objects=70,
  total_size=2,
  total_size_of_active_objects=2,
  used_allocated_memory=69,
  used_allocated_memory_5min=0
  1524529826000000000

LeoGateway

$ ./telegraf --config ./plugins/inputs/leofs/leo_gateway.conf --input-filter leofs --test
> leofs, host=gateway_0, node=gateway_0@127.0.0.1
  allocated_memory=87941120,
  allocated_memory_5min=88067672,
  count_of_cache-hit=0,
  count_of_cache-miss=0,
  ets_memory_usage=4843497,
  ets_memory_usage_5min=4841574,
  num_of_deletes=0,
  num_of_deletes_5min=0,
  num_of_processes=555,
  num_of_processes_5min=555,
  num_of_reads=0,
  num_of_reads_5min=0,
  num_of_writes=0,
  num_of_writes_5min=0,
  processes_memory_usage=17388052,
  processes_memory_usage_5min=17413928,
  system_memory_usage=49531263,
  system_memory_usage_5min=49577819,
  total_cached_size=0,
  total_memory_usage=66917393,
  total_memory_usage_5min=66989469,
  total_of_files=0,
  used_allocated_memory=69,
  used_allocated_memory_5min=69 1524105894000000000