--- relatedlinks: "[LXD's S3 API - YouTube](https://youtube.com/watch?v=T1EeXPrjkEY)" --- (howto-storage-buckets)= # How to manage storage buckets {ref}`storage-buckets` let you store and manage object-based data using either local or distributed storage. Unlike custom storage volumes, storage buckets cannot be attached to instances. Instead, applications access them directly via a URL using the S3 protocol. - For local buckets, the LXD server provides the S3-compatible URL via its {ref}`S3 address setting `. - For distributed buckets, a {ref}`Ceph RADOS Gateway endpoint ` provides the S3-compatible URL. (howto-storage-buckets-view)= ## View storage buckets `````{tabs} ````{group-tab} CLI To list all available storage buckets in a storage pool, run: ```bash lxc storage bucket list ``` To show detailed information about a specific bucket, run: ```bash lxc storage bucket show ``` ```` ````{group-tab} UI Select {guilabel}`Buckets` from the {guilabel}`Storage` section of the main navigation. ```` ````` (howto-storage-buckets-create)= ## Create a storage bucket (howto-storage-buckets-create-requirements)= ### Requirements Storage buckets can only be created in storage pools that use a driver capable of **object storage**. View the {ref}`storage-buckets` reference guide's {ref}`storage-drivers-features` table to see which drivers support object storage. Other requirements must be met before you can create a storage bucket, depending on whether you want to create a distributed or local storage bucket. (howto-storage-buckets-create-requirements-distributed)= #### Distributed storage buckets To create a distributed storage bucket, your LXD server must have access to a {ref}`Ceph Object ` storage pool. `````{tabs} ````{group-tab} CLI To view available storage pools, run: ```bash lxc storage list ``` If you see a storage pool in the output with the `cephobject` driver, you're all set. Continue on to the instructions below to {ref}`create a storage bucket `. If you don't see a pool that uses a `cephobject` storage driver, you must create one before you can continue. This requires a [Ceph](https://ceph.io) cluster with a RADOS Gateway (`radosgw`) enabled. See our how-to guide for storage pools: {ref}`howto-storage-pools-ceph-requirements`. ```` ````{group-tab} UI To create a storage bucket, select {guilabel}`Buckets` from the {guilabel}`Storage` section of the main navigation. On the resulting screen, click {guilabel}`Create bucket` in the upper-right corner. In the form that appears, set a unique name for the storage bucket and select a storage pool. You can optionally configure the bucket's size and description. Finally, click {guilabel}`Create bucket`. ```{figure} /images/storage/storage_buckets/storage_bucket_create.png :width: 60% :alt: Create Storage Buckets in LXD UI ``` ```` ````` (howto-storage-buckets-create-requirements-local)= #### Local storage buckets (howto-storage-buckets-create-requirements-local-minio)= ##### MinIO LXD uses [MinIO](https://min.io) to set up local storage buckets. To use this feature with LXD, you must install both the server and client binaries. - MinIO Server: - Source: - [MinIO Server on GitHub](https://github.com/minio/minio) - Direct download for various architectures: - [MinIO Server pre-built for `amd64`](https://dl.min.io/server/minio/release/linux-amd64/minio) - [MinIO Server pre-built for `arm64`](https://dl.min.io/server/minio/release/linux-arm64/minio) - [MinIO Server pre-built for `arm`](https://dl.min.io/server/minio/release/linux-arm/minio) - [MinIO Server pre-built for `ppc64le`](https://dl.min.io/server/minio/release/linux-ppc64le/minio) - [MinIO Server pre-built for `s390x`](https://dl.min.io/server/minio/release/linux-s390x/minio) - MinIO Client: - Source: - [MinIO Client on GitHub](https://github.com/minio/mc) - Direct download for various architectures: - [MinIO Client pre-built for `amd64`](https://dl.min.io/client/mc/release/linux-amd64/mc) - [MinIO Client pre-built for `arm64`](https://dl.min.io/client/mc/release/linux-arm64/mc) - [MinIO Client pre-built for `arm`](https://dl.min.io/client/mc/release/linux-arm/mc) - [MinIO Client pre-built for `ppc64le`](https://dl.min.io/client/mc/release/linux-ppc64le/mc) - [MinIO Client pre-built for `s390x`](https://dl.min.io/client/mc/release/linux-s390x/mc) If LXD is installed from a Snap, you must configure the snap environment to detect the binaries, and restart LXD. Note that the path to the directory containing the binaries must not be under the home directory of any user. ```bash snap set lxd minio.path=/path/to/directory/containing/both/binaries snap restart lxd ``` If LXD is installed from another source, both binaries must be included in the `$PATH` that LXD was started with. (howto-storage-buckets-create-requirements-local-s3)= ##### Configure the S3 address Storage buckets provide access to object storage exposed using the S3 protocol. If you want to use storage buckets on local storage (thus in a `dir`, `btrfs`, `lvm`, or `zfs` pool), you must configure the S3 address for your LXD server. This is the address that you can then use to access the buckets through the S3 protocol. To configure the S3 address, set the {config:option}`server-core:core.storage_buckets_address` server configuration option. For example: ```bash lxc config set core.storage_buckets_address :8555 ``` (howto-storage-buckets-create-single)= ### Create a bucket on a single, non-clustered LXD server To create a local or distributed storage bucket on a non-clustered LXD server, run: ```bash lxc storage bucket create [configuration_options...] ``` See the {ref}`storage-drivers` documentation for a list of available storage bucket configuration options for each driver that supports object storage. (howto-storage-buckets-create-cluster)= ### Create a bucket on a cluster member #### Distributed storage buckets Storage buckets created in `cephobject` storage pools are available from any LXD cluster member. Thus, to create this bucket, the command remains the same as for a non-clustered LXD server: ```bash lxc storage bucket create [configuration_options...] ``` #### Local storage buckets For local storage drivers, storage buckets are not replicated across the cluster and exist only on the member for which they were created. To create a storage bucket on a cluster member, add the `--target` flag: ```bash lxc storage bucket create --target= [configuration_options...] ``` (howto-storage-buckets-configure)= ## Configure storage bucket settings See the {ref}`storage-drivers` documentation for the available configuration options for each storage driver that supports object storage. `````{tabs} ````{group-tab} CLI Use the following command to set configuration options for a storage bucket: ```bash lxc storage bucket set ``` For example, to set the size (quota) of a bucket, use the following command: ```bash lxc storage bucket set my-pool my-bucket size 1MiB ``` You can also edit the storage bucket configuration by using the following command: ```bash lxc storage bucket edit ``` Use the following command to delete a storage bucket and its keys: ```bash lxc storage bucket delete ``` ```` ````{group-tab} UI To configure a storage bucket, select {guilabel}`Buckets` from the {guilabel}`Storage` section of the main navigation. The resulting screen shows a list of existing storage buckets. Click the {guilabel}`Edit` button on the row of the desired bucket to access its details. After making changes, click the {guilabel}`Save changes` button. This button also displays the number of changes you have made. ```` ````` (howto-storage-buckets-resize)= ## Resize a storage bucket By default, storage buckets do not have a quota applied. `````{tabs} ````{group-tab} CLI To set or change a quota for a storage bucket, set its size configuration: ```bash lxc storage bucket set size ``` ```{important} - Growing a storage bucket usually works (if the storage pool has sufficient storage). - You cannot shrink a storage bucket below its current used size. ``` ```` ````{group-tab} UI To configure a storage bucket, select {guilabel}`Buckets` from the {guilabel}`Storage` section of the main navigation. The resulting screen shows a list of existing storage buckets. Change the quota of the bucket by changing the values in the {guilabel}`Size` fields. After making changes, click the {guilabel}`Save changes` button. This button also displays the number of changes you have made. ```` ````` (howto-storage-buckets-keys)= ## Manage storage bucket keys To access a storage bucket, applications must use a set of S3 credentials made up of an *access key* and a *secret key*. You can create multiple sets of credentials for a specific bucket. Each set of credentials is given a key name. The key name is used only for reference and does not need to be provided to the application that uses the credentials. Each set of credentials has a *role* that specifies what operations they can perform on the bucket. The roles available are: - `admin` - Full access to the bucket - `read-only` - Read-only access to the bucket (list and get files only) If the role is not specified when creating a bucket key, the role used is `read-only`. (howto-storage-buckets-keys-view)= ### View storage bucket keys `````{tabs} ````{group-tab} CLI Use the following command to see the keys defined for an existing bucket: ``` lxc storage bucket key list ``` Use the following command to see a specific bucket key: ``` lxc storage bucket key show ``` ```` ````{group-tab} UI To view storage bucket keys, select {guilabel}`Buckets` from the {guilabel}`Storage` section of the main navigation. Click the name of a storage bucket to display its key management page, where you can view and manage a list of keys for that bucket. ```{figure} /images/storage/storage_buckets/storage_bucket_key_list.png :width: 80% :alt: List Storage Bucket keys in LXD UI ``` ```` ````` (howto-storage-buckets-keys-create)= ### Create keys `````{tabs} ````{group-tab} CLI Use the following command to create a set of credentials for a storage bucket: ```bash lxc storage bucket key create [configuration_options...] ``` Use the following command to create a set of credentials for a storage bucket with a specific role: ```bash lxc storage bucket key create --role=admin [configuration_options...] ``` These commands will generate and display a random set of credential keys. ```` ````{group-tab} UI To create a storage bucket key, go to the {ref}`key management page ` of the desired bucket. On the resulting screen, click {guilabel}`Create key` in the upper-right corner. In the form that appears, set a unique name for the key. You can optionally configure the role, description of your storage bucket key. While you can enter values for the {guilabel}`Access` and {guilabel}`Secret Key` fields, this is not necessary. You can leave them blank, and LXD will generate random values for those credential keys. Finally, click {guilabel}`Create key`. ```{figure} /images/storage/storage_buckets/storage_bucket_create_key.png :width: 60% :alt: Create Storage Bucket keys in LXD UI ``` ```` ````` (howto-storage-buckets-keys-edit)= ### Edit or delete storage bucket keys `````{tabs} ````{group-tab} CLI Use the following command to edit an existing bucket key: ```bash lxc storage bucket key edit ``` Use the following command to delete an existing bucket key: ```bash lxc storage bucket key delete ``` ```` ````{group-tab} UI To edit or delete storage bucket keys, go to the {ref}`key management page ` of the desired bucket. From here, use the {guilabel}`Edit` or {guilabel}`Delete` button in the row of the target key. ```` `````