Using MapR Data Platform Monitoring (Spyglass Initiative)

MapR Data Platform Monitoring (part of the Spyglass initiative) provides the ability to collect, store, and view metrics and logs for nodes, services, and jobs/applications.

Metric Monitoring

Administrators can monitor the current status of the cluster and anticipate future cluster requirements with dashboards. For example, you can use metrics dashboards to visualize the following:
Storage Utilization
Use metrics dashboards to monitor storage trends. For example, you can compare the volume of MapR File System usage at different times to the MapR File System capacity and then allocate resources to the MapR File System accordingly.
Node Utilization
Use metrics dashboards to check for node overload. For example, if the CPU usage is high on a few nodes, you may want to distribute the load across more nodes for better performance and efficiency.
MapR Database Operational Trends
Use metrics dashboards to display historical trends for MapR Database operations. For example, if a user reports MapR Database slowness, the historical trends associated with row scans, get, and put operations can be used to identify the node(s) on which the performance degradation occurs.

Log Monitoring

Administrators can use dashboards to visualize, search, and review logs when troubleshooting issues. For example, you can use log dashboards to troubleshoot the following issues:
Service Failures
When metrics indicate that one or more services are down, use log dashboards to check the logs for each failed service and drill-down to each associated node.
Application Failures
When an application or job fails, use log dashboard to identify possible bottlenecks. For example, you can search the logs for a given application ID across all the nodes in the cluster.
MapR File System Performance
When users experience MapR File System or NFS slowness, use log dashboards to search the MapR filesystem logs for service errors or application issues.

Related Information