HPE Ezmeral Data Fabric 6.2 is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About Release 6.2
This site contains documentation for HPE Ezmeral Data Fabric release 6.2 including installation, configuration, administration, and reference content, as well as content for the associated bundled ecosystem components and drivers.
6.2 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
6.2 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.2 Administration
This section describes how to manage the nodes and services that make up a cluster.
- Administering Users and Clusters
  Lists topics that help manage a data-fabric cluster.
- Administering Nodes
  Provides a synopsis of managing nodes in a cluster.
- Administering Volumes
  This section provide information about how to organize and manage data using volumes, a unique feature of HPE Ezmeral Data Fabric clusters.
- Administering Files and Directories
- Administering Tables
  Administration of the HPE Ezmeral Data Fabric Database is done primarily via the command line (maprcli) or with the Managed Control System (MCS). Regardless of whether the HPE Ezmeral Data Fabric Database table is used for binary files or JSON documents, the same types of commands are used with slightly different parameter options. HPE Ezmeral Data Fabric Database administration is associated with tables, columns and column families, and table regions.
- Administering Streams
- Administering Data Fabric Gateways
  A HPE Ezmeral Data Fabric gateway mediates one-way communication between a source HPE Ezmeral Data Fabric cluster and a destination cluster. You can replicate HPE Ezmeral Data Fabric Database tables (binary and JSON) and HPE Ezmeral Data Fabric Streams streams. HPE Ezmeral Data Fabric gateways also apply updates from JSON tables to their secondary indexes and propagate Change Data Capture (CDC) logs.
- Administering Services
- Monitoring the Cluster
  This section describes how to monitor the health and performance of a MapR cluster.
- Configuring Security
  Describes how to configure security and manage secure clusters.
- Managing Secure Clusters
  Provides procedures that will enable you to use MapR clusters securely.
- Administering the Data Access Gateway
  The HPE Ezmeral Data Fabric Data Access Gateway is a service that acts as a proxy and gateway for translating requests between lightweight client applications and the HPE Ezmeral Data Fabric cluster. This section describes considerations when upgrading the service, how to modify configuration settings, and how to administer and manage the service.
- Planning for High Availability
- Administrator's Reference
  This section contains in-depth reference information for the administrator.
  - maprcli and REST API Syntax
    This section provides information about the HPE Ezmeral Data Fabric command API. Most commands can be run on the command-line interface (CLI), or by making REST requests programmatically or in a browser.
  - Utilities
    Contains information about various scripts and utilities, that help setup, maintain, and monitor clusters.
    - configure.sh
      Describes the syntax and parameters of the configure.sh script that you run for a number of tasks including setting up HPE Ezmeral Data Fabric client nodes, and configuring services for a node.
    - configure-crosscluster.sh
      Use the configure-crosscluster.sh utility to set up cross-cluster security between two clusters.
    - cldbguts
      Monitors the activity of the Container Location Database (CLDB). This utility prints information about the CLDB service that is running on the node from which you run the utility.
    - disksetup
      Describes the disksetup command that formats disks for use by HPE Ezmeral Data Fabric storage.
    - ectool
      Dumps or checks the validity of the stripelets in the backend volume that is associated with the volume configured for warm tiering.
    - expandaudit
      Describes how to use the expandaudit utility to expand IDs captured in the audit logs to their corresponding names.
    - fcdebug
      Dynamically sets the log level to debug a library.
    - fsck
      Detects and fixes inconsistencies in the filesystem.
    - gfsck
      Describes how you can use the gfsck command, under the supervision of HPE Ezmeral Data Fabric Support or Engineering, to perform consistency checks and appropriate repairs on a volume, or a volume snapshot.
    - guts
      guts is a tool to measure/analyse performance. In the default mode, it prints one line every second, and counts the number of operations or bytes-processed in one second intervals. guts is an internal utility, and is subject to change without notice.
    - manageSSLKeys.sh
      Use the manageSSLKeys.sh utility to create and manage SSL certificates.
    - mapr-support-collect.sh
      Collects information about a cluster's recent activity, to help Data Fabric Support diagnose problems.
    - mapr-support-dump.sh
      Collects node and cluster-level information for the node on which you invoke the script.
    - maprlogin
      Authenticates logins to secure HPE Ezmeral Data Fabric clusters.
    - mrconfig
      The mrconfig commands let you create, remove, and manage storage pools, disk groups, and disks; and provide information about containers.
      - mrconfig cntr
        Discusses the mrconfig cntr commands that allow you to manage containers and container replicas.
      - mrconfig dbinfo
        Each instance of the file server on a node is responsible for processing and tracking activities that result from running database commands. The mrconfig dbinfo command displays information about the activities, including information related to containers, tablets, storage pools, tags, and threads processing operations on tables.
        mrconfig dbinfo arena
        The mrconfig dbinfo arena command displays all the database related arenas (contiguous piece of memory), including the arena count and byte allocated.
        mrconfig dbinfo autosetup
        The mrconfig dbinfo autosetup command displays information about replica autosetup for database tables.
        mrconfig dbinfo cidmapcache
        The mrconfig dbinfo cidmapcache command displays the number of entries in the container ID cache and the number of successful and unsuccessful lookups performed by each instance of the file server on the cache.
        mrconfig dbinfo copyregiontrackers
        The mrconfig dbinfo copyregiontrackers command displays information about copy region progress for tables upon a replica autosetup.
        mrconfig dbinfo copyregionworkers
        The mrconfig dbinfo copyregionworkers command displays information about the worker threads for parallel copy regions.
        mrconfig dbinfo mem
        The mrconfig dbinfo mem command displays memory information related to storage pools and buckets.
        mrconfig dbinfo replbuckets
        The mrconfig dbinfo replbuckets command displays the replication progress information for the data in each bucket for each replica of a table.
        mrconfig dbinfo repltable
        The mrconfig dbinfo repltable command displays information about all the replicas setup on a table.
        mrconfig dbinfo tablets
        The mrconfig dbinfo tablets command displays information about tablets (table regions).
        mrconfig dbinfo tabletsplits
        The mrconfig dbinfo tabletsplits command displays information about the tablets (table regions) being split.
        mrconfig dbinfo threads
        The mrconfig dbinfo threads command displays information about the throttling queue for each thread processing BatchGet operations, such as the number of free and maximum slots. The command also displays the work areas (WA) for the RPCs being processed by the file server.
      - mrconfig dg
        This section discusses the mrconfig dg commands that allow you to configure disk groups.
      - mrconfig disk
        This section discusses the mrconfig disk commands.
      - mrconfig info
        The mrconfig info commands provide information about memory, threads, volumes, containers and other information about the Data Fabric file system.
      - mrconfig mastgateway
        This section describes the mrconfig mastgateway commands that allow you to test PUT, GET, and DELETE operations on the corresponding tier.
      - mrconfig sp
        The mrconfig sp commands create and control storage pools.
    - mrdirectorystats
      Prints the space usage for each directory, for a container.
    - mrdiagnostics
      Gathers node metrics.
    - mrfscmd
      Returns the path to the file specified by ID (fid).
    - pullcentralconfig
      Pulls master configuration files from /var/mapr/configuration on the cluster to the local disk, on each node.
    - stubfuse
      Simulates a FUSE mount point to determine its read and write performance.
  - Configuration Files
    This section contains reference information about various configuration files.
  - Alarms Reference
    The pages in this section provide details about all of the types of alarms.
  - HPE Ezmeral Data Fabric Environment
    This section provides information associated with the Data Fabric environment.
- Troubleshooting Cluster Administration
  Lists the common errors and their solutions.
- Best Practices for Backing Up HPE Ezmeral Data Fabric Information
  Lists the best practices and performance considerations to follow when backing up HPE Ezmeral Data Fabric information.
6.2 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

mrconfig dbinfo threads

The mrconfig dbinfo threads command displays information about the throttling queue for each thread processing BatchGet operations, such as the number of free and maximum slots. The command also displays the work areas (WA) for the RPCs being processed by the file server.

You can configure the number of operations that run in parallel in mfs.conf through the mfs.db.max.concurrent.internal.ops option. See mrconfigfor instructions about running mrconfig commands.

Syntax

/opt/mapr/server/mrconfig dbinfo threads

Example

Display the throttling queue information for BatchGet operations and work areas (WA) for the RPCs currently being processed by the file server.

/opt/mapr/server/mrconfig dbinfo threads
----------------------
Time: 2020-08-13 12:08:33,9402 Instance 5662
----------------------
ThrottleQ : maxSlots 1024 freeSlots 1016 hasWaiters 0 totalWaits 0
InternalOpThrottleQ1 : maxSlots 24576 freeSlots 24576 hasWaiters 0 totalWaits 0
InternalOpThrottleQ2 : maxSlots 24576 freeSlots 24576 hasWaiters 0 totalWaits 0
InternalOpThrottleQ3 : maxSlots 24576 freeSlots 24576 hasWaiters 0 totalWaits 0
thread:ScanWA wa:0x25a0910000 file:fs/server/db/rpc/scan.cc line:967 cbarg:0x271cbf0000
thread:ScanWA wa:0x25b81b1e00 file:fs/server/db/rpc/scan.cc line:967 cbarg:0x2653bd0000
thread:ScanWA wa:0x26d27a2800 file:fs/server/db/rpc/scan.cc line:967 cbarg:0x26ef476000
thread:ScanWA wa:0x25a0911e00 file:fs/server/db/rpc/scan.cc line:967 cbarg:0x269d60e000
thread:SingleScanWA wa:0x271cbf0000 file:fs/server/db/rpc/scan.cc line:303 cbarg:0x0
thread:SingleScanWA wa:0x2653bd0000 file:fs/server/db/rpc/scan.cc line:303 cbarg:0x0
thread:SingleScanWA wa:0x26ef476000 file:fs/server/db/rpc/scan.cc line:303 cbarg:0x0
thread:SingleScanWA wa:0x269d60e000 file:fs/server/db/rpc/scan.cc line:303 cbarg:0x0