Installing S3 Gateway

The S3 Gateway is an object storage server that can be used with the Amazon S3 cloud storage service.

NOTICE The S3 gateway is included in EEP 6.0.0 - EEP 8.0.0 repositories.

This topic provides instructions for manually installing the S3 gateway version 1.0.x on an Edge node or on a server node (for example, a MapR cluster node) that is running MapR software.

The S3 gateway has two packages:
Package Name Description
mapr-objectstore-client The binary package.
mapr-objectstore-gateway The role package that includes Warden configuration information.
NOTE You cannot install the S3 gateway with the MapR Installer.

Requirements

The S3 gateway has the following requirements:
  • A working MapR cluster. Connecting to a MapR cluster requires either mapr-core or mapr-client, depending on the node type. A server node must have mapr-core installed. An Edge node must have mapr-client installed.
  • For Ubuntu only, install the syslinux-utils package:
    sudo apt install syslinux-utils
  • For Zypper only, install the libcap-progs package:
    sudo zypper install libcap-progs
  • A POSIX client must be installed and configured on each node where the S3 gateway will be used.
  • JDK version 8 or higher.
Installing and Configuring a POSIX client for the S3 gateway
NOTE The following instructions install the POSIX client (for a basic license) and JDK 8. If JDK 8 is already installed, omit it when you run the installation command. For more information about POSIX, see Installing FUSE-based POSIX Client Packages.
  1. To install the POSIX client and JDK 8, run the command appropriate for your system:
    • Ubuntu
      sudo apt install openjdk-8-jdk-headless mapr-posix-client-basic
    • RedHat/CentOS
      sudo yum install java-1.8.0-openjdk.x86_64 mapr-posix-client-basic
    • SLES
      sudo zypper install java-1.8.0-openjdk.x86_64 mapr-posix-client-basic
  2. In the /opt/mapr/conf/fuse.conf file, set the mount directory and the path to the user ticket.
    • fuse.mount.point - Use this parameter to set the mount directory. The default setting is /mapr.
    • fuse.ticketfile.location – Use this parameter to set the path to the user ticket.
  3. Create a mount directory and set permissions, as shown:
    mkdir -m 777 /mapr
  4. Start the MapR Posix service:
    sudo systemctl start
    mapr-posix-client-basic.service
    
  5. Verify that the MapR cluster is mounted to the /mapr directory:
    ls -la /mapr
    
    You should see a directory with the MapR cluster name and cluster data inside. By default, the directory is 'my.cluster.com' unless you define a different name for the cluster, for example:
    ls -la /mapr/
    total 1
    drwxr-xr-x 7 mapr mapr 6 Feb 16 18:06 example.mapr.cluster
    

Edge Node Installation

An Edge node must have the mapr-client installed before you install the S3 gateway.

Run commands as root or using sudo.
To install the S3 gateway on an Edge node, complete the following steps:
  1. Configure the repositories for MapR core and EEP components:
  2. Update the repositories on the Edge node:
    • Ubuntu
      sudo apt-get update
    • RedHat/CentOS
      sudo yum clean all
      sudo yum makecache --refresh
    • SLES
      sudo zypper ref
  3. To install the S3 gateway, run the command appropriate for your system:
    • Ubuntu
      sudo apt install mapr-objectstore-client
    • RedHat/CentOS
      sudo yum install mapr-objectstore-client
    • SLES
      sudo zypper install mapr-objectstore-client
  4. Run the /opt/mapr/objectstore-client/objectstore-client-x.x.x/bin/configure.sh script to configure the S3 gateway:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/configure.sh -c -u <userName> -g <groupName> --path /path/to/filesystem/
    
    #In this command:
    -c is the client node with the objectstore-client.
    -u(--user) is the user admin for working with the objectstore-client.
    -g(--group) is the group.
    -p(--path) is the path name in the shared file system where the S3 gateway should look for objects.
  5. To start the S3 gateway, run the objectstore.sh script:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh start
  6. Verify that the S3 gateway process is running:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh status

    When the S3 gateway is running, the system returns: Minio is running

  7. Configure the S3 gateway. See Configuring S3 Gateway for instructions.
To delete the S3 gateway on an Edge node, complete the following steps:
  1. Stop the S3 gateway service:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh stop
  2. Delete the packages from the system:
    • Ubuntu
      sudo apt remove mapr-objectstore-client --purge
    • RedHat/CentOS
      sudo yum remove mapr-objectstore-client
    • SLES
      sudo zypper remove mapr-objectstore-client

Server Node Installation

A server in this context refers to a node in a MapR cluster. A server node must have mapr-core installed before you can install the S3 gateway.

Run commands as a user with admin privileges on the cluster.
To install the S3 gateway on a server, complete the following steps:
  1. Verify that the following requirements are met:
    • MapR software is installed on the server, and the EEP 6.x repositories are configured. For more information about configuring repositories, see Step 2: Prepare Packages and Repositories.
    • The MapR POSIX client is installed.
    • For Ubuntu clusters, you must install syslinux-utils:
      sudo apt install syslinux-utils
    • To support impersonation in SLES clusters, you must install the libcap-progs library:
      sudo zypper install libcap-progs
  2. Update the repositories:
    • Ubuntu
      sudo apt-get update
    • RedHat/CentOS
      sudo yum clean all
      sudo yum makecache --refresh
    • SLES
      sudo zypper ref
  3. To install the S3 gateway, run the command appropriate for your system:
    • Ubuntu
      sudo apt install mapr-objectstore-gateway mapr-objectstore-client
    • RedHat/CentOS
      sudo yum install mapr-objectstore-gateway mapr-objectstore-client
    • SLES
      sudo zypper install mapr-objectstore-gateway mapr-objectstore-client
  4. To configure Warden, use configure.sh on the first run:
    sudo /opt/mapr/server/configure.sh -R
  5. Verify that the S3 gateway process is running:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh status

    When the S3 gateway is running, the system returns: Minio is running

  6. Configure the S3 gateway. See Configuring S3 Gateway for instructions.
To delete the S3 gateway on a Server node, complete the following steps:
  1. Stop the objectstore service:
    /opt/mapr/bin/maprcli node services -name objectstore -nodes <node_name> -action stop
  2. Delete the packages from the system:
    • Ubuntu
      sudo apt remove mapr-objectstore-gateway --purge 
      sudo apt remove mapr-objectstore-client --purge
    • RedHat/CentOS
      sudo yum remove mapr-objectstore-gateway 
      sudo yum remove mapr-objectstore-client
    • SLES
      sudo zypper remove mapr-objectstore-gateway 
      sudo zypper remove mapr-objectstore-client