Installing S3 Gateway

The S3 Gateway is an object storage server that can be used with the Amazon S3 cloud storage service.

NOTICE The S3 gateway is included in EEP 6.0.0 - EEP 8.0.0 repositories.

This topic provides instructions for manually installing the S3 gateway version 2.0.0 on an Edge node or on a server node (for example, a data-fabric cluster node) that is running core software.

Requirements

Before installation, review these requirements for the S3 Gateway:
Requirement Description
Cluster packages The S3 Gateway requires a working data-fabric cluster. Connecting to the cluster requires either mapr-core or mapr-client, depending on the node type:
  • A server node must have mapr-core installed.
  • An edge node must have mapr-client installed.
syslinux- utils package (Ubuntu only) For Ubuntu only, you must install the syslinux-utils package: 
sudo apt install syslinux-utils
libcap- progs package (Zypper only) For Zypper only, you must install the libcap-progs package:
sudo zypper install libcap-progs
POSIX client A POSIX client must be installed and configured on each node where the S3 Gateway will be used. See Installing and Configuring a POSIX client for the S3 Gateway.
Object Store packages Two packages are available for download:
  • mapr-objectstore-client - the binary package
  • mapr-objectstore-gateway - the role package that includes the Warden configuration information
For edge nodes, you install the mapr-objectstore-client package only. For server nodes, you install the mapr-objectstore-gateway and mapr-objectstore-client packages.

Installing and Configuring a POSIX client for the S3 Gateway

To install and configure the POSIX client on a node:
  1. Install the POSIX client:
    • Red Hat / CentOS:
      sudo yum install mapr-posix-client-basic
    • Ubuntu:
      sudo apt install mapr-posix-client-basic
    • SLES:
      sudo zypper install mapr-posix-client-basic
  2. In the /opt/mapr/conf/fuse.conf file, set the mount directory and the path to the user ticket:
    1. Use the fuse.mount.point parameter to set the mount directory. The default setting is /mapr.
    2. Use the fuse.ticketfile.location parameter to set the path to the user ticket.
  3. Create a mount directory and set permissions as follows: 
    mkdir -m 777 /mapr
  4. Start the POSIX service:
    sudo systemctl start
mapr-posix-client-basic.service
  5. Verify that the data-fabric cluster is mounted to the /mapr directory:
    ls -la /mapr
    For example:
    ls -la /mapr/
total 1
drwxr-xr-x 7 mapr mapr 6 Feb 16 18:06 example.mapr.cluster

You should see a directory with the data-fabric cluster name and cluster data inside. By default, the directory is my.cluster.com unless you define a different name for the cluster.

Installation

You can install the S3 gateway version 2.0.0 on an edge node or server node that runs data-fabric software. To install the S3 gateway manually, use the following steps. To install the S3 gateway using the Installer, see Installing the S3 Gateway Using the Installer.

Edge Node Installation (Manual Steps)

Use the following steps to install the S3 Gateway on an edge node:
  1. Install the mapr-objectstore-client package:
    • Red Hat / CentOS:
      sudo yum install mapr-objectstore-client
    • Ubuntu:
      sudo apt install mapr-objectstore-client
    • SLES:
      sudo zypper install mapr-objectstore-client
  2. Run the objectstore configure.sh script, as shown, to configure the S3 gateway:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/configure.sh -c -u <userName> -g <groupName> --path /path/to/filesystem/
    In this command:
    -c is the client node of the mapr-objectstore-client
    -u (--user) is the user admin for working with the mapr-objectstore-client
    -g (--group) is the group
    -p (--path) is the path for mounting the filesystem
    For example:
    sudo /opt/mapr/objectstore-client/objectstore-client-2.0.0/bin/configure.sh -c -u mapr -g mapr --path /mapr/my.cluster.com/objectstore
  3. Run the objectstore.sh script to start the S3 gateway:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh start
  4. Verify that the S3 gateway process is running:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh status
    When the process is running, the system prints the following message:
    Minio is running
  5. Configure the S3 gateway. For details, see Configuring S3 Gateway.

Server Node Installation (Manual Steps)

Use the following steps to install the S3 Gateway on a server node:
  1. Install the mapr-objectstore-gateway and mapr-objectstore-client packages:
    • Red Hat / CentOS:
      sudo yum install mapr-objectstore-client mapr-objectstore-gateway
    • Ubuntu:
      sudo apt install mapr-objectstore-client mapr-objectstore-gateway
    • SLES:
      sudo zypper install mapr-objectstore-client mapr-objectstore-gateway
  2. Set the accessKey and secretKey in /opt/mapr/objectstore-client/objectstore-client-<version>/conf/minio.json.
  3. To configure Warden, use configure.sh on the first run:
    sudo /opt/mapr/server/configure.sh -R
  4. Verify that the S3 gateway process is running:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh status
    When the process is running, the system prints the following message:
    Minio is running
  5. Configure the S3 gateway. For details, see Configuring S3 Gateway.