Purdue University

Managing Buckets and Objects

Link to section 'Accessing Depot Object Storage' of 'Managing Buckets and Objects' Accessing Depot Object Storage

The S3 endpoint provided by Depot Object can be accessed in multiple ways. Two popular options for interacting with S3 storage via the command line and GUI are listed below.

Endpoint: s3.rcac.purdue.edu

Link to section 's3cmd User Guide' of 'Managing Buckets and Objects' s3cmd User Guide

s3cmd is a free command line tool for managing data in S3 compatible storage resources that works on Linux and Mac. This section provides a basic overview of using s3cmd to manage Depot Object storage.

Link to section 'Table of Contents' of 'Managing Buckets and Objects' Table of Contents

• Installation
• Authentication
• Basic Commands
• Object Management
• Bucket Management
• More Information

Link to section 'Installation' of 'Managing Buckets and Objects' Installation

To use s3cmd, first ensure you have it installed on your system. You can install it via pip:

pip install s3cmd

Link to section 'Authentication' of 'Managing Buckets and Objects' Authentication

Before using s3cmd to interact with your S3 storage, you need to configure your .s3cfg file.

The s3cmd configuration file should have the following format. Access keys and secret keys can be obtained via rcac-help@purdue.edu.

[default]

host_base = s3.rcac.purdue.edu
host_bucket = s3.rcac.purdue.edu
access_key = <your access key>
secret_key = <your secret key>

Link to section 'Basic Commands' of 'Managing Buckets and Objects' Basic Commands

• s3cmd list (ls): This lists all the buckets associated with your account.
• s3cmd sync: Syncs directories on your machine to or from S3.
• s3cmd put: Uploads an object to S3.
• s3cmd get: Downloads an object from S3.

Link to section 'Bucket Management' of 'Managing Buckets and Objects' Bucket Management

• s3cmd mb s3://<bucket>: Creates a new bucket.
• s3cmd rb s3://<bucket>: Deletes an entire bucket, including all objects within it. This is irreversible, so use with caution.

Link to section 'Object Management' of 'Managing Buckets and Objects' Object Management

• s3cmd put: This is used for uploading files to your bucket.
• s3cmd get: Use this command to download an object from S3, specifying both the bucket and object name where necessary.

Link to section 'More Information' of 'Managing Buckets and Objects' More Information

For detailed usage and options, run `s3cmd --help` from your terminal/command prompt.

• Download: https://s3tools.org/download
• How-To Documentation: https://s3tools.org/s3cmd-howto

Link to section 'Cyberduck' of 'Managing Buckets and Objects' Cyberduck

Cyberduck is a free server and cloud storage browser that can be used on Windows and Mac.

1. Download and install Cyberduck

2. Launch Cyberduck

3. Click + Open Connection at the top of the UI.

4. Select S3 from the dropdown menu

5. Fill in Server, Access Key ID and Secret Access Key fields

6. Click Connect

7. You can now right click to bring up a menu of actions that can be performed against the storage endpoint

Further information about using Cyberduck can be found on the Cyberduck documentation site.