Skip to content

OpenCloud - Minio Integration

Verschoben OpenCloud
2 1 75
  • Die Konfiguration zeigt einem aber auch immer schöne neue Sachen, die man unbedingt ausprobieren muss 🙂 Eines, wo ich beim Lesen der Konfiguration gestolpert bin, ist die Minio / S3 Integration. Wie praktisch, wenn man einen Minio-Server schon laufen hat.

    # S3 Storage configuration - optional
    # OpenCloud supports S3 storage as primary storage.
    # Per default, S3 storage is disabled and the decomposed storage driver is used.
    # To enable S3 storage, uncomment the following line and configure the S3 storage.
    # For more details see:
    # https://docs.opencloud.eu/docs/admin/configuration/storage-decomposeds3
    # Note: the leading colon is required to enable the service.
    DECOMPOSEDS3=:decomposeds3.yml
    # Configure the S3 storage endpoint. Defaults to "http://minio:9000" for testing purposes.
    DECOMPOSEDS3_ENDPOINT=https://minio.example.org
    # S3 region. Defaults to "default".
    DECOMPOSEDS3_REGION=default
    # S3 access key. Defaults to "opencloud"
    DECOMPOSEDS3_ACCESS_KEY=<ACCESS KEY>
    # S3 secret. Defaults to "opencloud-secret-key"
    DECOMPOSEDS3_SECRET_KEY=<SECRET KEY>
    # S3 bucket. Defaults to "opencloud"
    DECOMPOSEDS3_BUCKET=opencloud-bucket
    #
    # For testing purposes, add local minio S3 storage to the docker-compose file.
    # The leading colon is required to enable the service.
    #DECOMPOSEDS3_MINIO=:minio.yml
    # Minio domain. Defaults to "minio.opencloud.test".
    MINIO_DOMAIN=https://minio.example.org
    

    So, das ist die funktionierende Konfiguration. Bitte drauf achten, wie ihr Eure Minio Installation erreicht, meine Installation ist so aufgebaut das ich keine Ports brauche. Hatte am Anfang aber mit :9000 getestet. Das führte aber zu kaputten Files.

    069d1bf8-da52-4237-9c47-92f8168dfd42-image.png

    Rechts unten, bei der Eieruhr stand dann This item is in processing Das ging auch durch einen kompletter Neustart nicht weg.

    Also heute morgen mal bei den Entwicklern im Matrix Channel nachgefragt. Wenige Minuten später die Antwort. Danke schön dafür!

    Ab in die Bash des Containers.

    docker exec -it opencloud_full-opencloud-1 bash
    

    Dann hatte ich das hier eingegeben.

    ccca410bf52a:~$ opencloud storage-users uploads sessions
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset  |  Size   |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       |  848052 |  848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |         |         |                                      |                                      |                      |            |                      |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2c96a3f3-10f3-4490-a3d1-05c2c013c030 | New file.txt                   |       9 |       9 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:49Z | true       | 0001-01-01T00:00:00Z |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | c3a75ec3-610b-4601-b839-fe109eeea53f | Delta Force   20.12.2024       | 1771546 | 1771546 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:06:48Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 17_25_21.png                   |         |         |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions --resume
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset  |  Size   |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       |  848052 |  848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |         |         |                                      |                                      |                      |            |                      |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2c96a3f3-10f3-4490-a3d1-05c2c013c030 | New file.txt                   |       9 |       9 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:49Z | true       | 0001-01-01T00:00:00Z |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | c3a75ec3-610b-4601-b839-fe109eeea53f | Delta Force   20.12.2024       | 1771546 | 1771546 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:06:48Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 17_25_21.png                   |         |         |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions --resume
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset |  Size  |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       | 848052 | 848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |        |        |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset |  Size  |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       | 848052 | 848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |        |        |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions --restart
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset |  Size  |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       | 848052 | 848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |        |        |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    

    Das war die Antwort

    You can run opencloud storage-users uploads sessions to see the queue
    opencloud storage-users uploads sessions --resume repeats the previous step
    opencloud storage-users uploads sessions --restart restarts the whole process
    But please make sure that your S3 config is working
    Another issue can occur, when you have clamav and the virusscanner is not responding

    opencloud storage-users uploads sessions # see the queue
    opencloud storage-users uploads sessions --resume # repeats the previous step
    opencloud storage-users uploads sessions --restart # restarts the whole process
    

    Danach hatte ich die drei hängenden Files wieder ordentlich.

    Tipp, schön drauf achten, dass man die richtigen Zugangsdaten anwendet 🙂

    Und jetzt werde ich das mal die nächsten Tage testen.

  • FrankMF FrankM verschob dieses Thema von Linux
  • Ich habe das wieder abgeschaltet, da es in meinem Setup zu viel der schnellen Oberfläche kaputt macht. Beide Installationen als VMs bei Hetzner. Da bleibe ich für meinen Fall, soll sowieso nur für mich und evtl. ein paar Familienmitglieder sein, bei der lokalen Speicherung. Das ist schneller und fühlt sich einfach besser an 😉

  • Linux security update [DSA 5658-1]

    Linux linux
    1
    0 Stimmen
    1 Beiträge
    275 Aufrufe
    Niemand hat geantwortet
  • Nextcloud - Hub 5 (27.0.0)

    Nextcloud nextcloud hub5 linux
    1
    0 Stimmen
    1 Beiträge
    144 Aufrufe
    Niemand hat geantwortet
  • NAS 2023 - Software Teil 1

    Angeheftet Verschoben Linux nas linux
    1
    4
    0 Stimmen
    1 Beiträge
    274 Aufrufe
    Niemand hat geantwortet
  • Flatpak Paket zurückrollen

    Linux flatpak linux
    1
    0 Stimmen
    1 Beiträge
    98 Aufrufe
    Niemand hat geantwortet
  • Star64 lieferbar

    Star64 star64 risc-v linux
    1
    0 Stimmen
    1 Beiträge
    107 Aufrufe
    Niemand hat geantwortet
  • Mainline 5.13.x

    Images linux rockpro64
    1
    0 Stimmen
    1 Beiträge
    238 Aufrufe
    Niemand hat geantwortet
  • Restic & Rclone & Nextcloud

    Linux nextcloud rclone linux restic
    3
    0 Stimmen
    3 Beiträge
    837 Aufrufe
    FrankMF
    Hier mal eine Ausgabe vom ersten Durchgang root@frank-MS-7C37:~# restic --password-file /root/passwd -r rclone:Nextcloud:HOME_UBUNTU backup --files-from /root/includes.txt repository 99xxxxa0 opened successfully, password is correct created new cache in /root/.cache/restic rclone: 2020/05/08 17:47:57 ERROR : locks: error listing: directory not found rclone: 2020/05/08 17:47:58 ERROR : index: error listing: directory not found rclone: 2020/05/08 17:47:58 ERROR : snapshots: error listing: directory not found Files: 3503 new, 0 changed, 0 unmodified Dirs: 2 new, 0 changed, 0 unmodified Added to the repo: 16.872 GiB processed 3503 files, 21.134 GiB in 1:02:56 snapshot fdxxxxec saved Der erste Durchgang hat also etwa eine Stunde benötigt. Durch die Deduplikation der Daten, ist der Vorgang beim zweiten Durchgang viel schneller weil nur neue oder geänderte Daten gesichert werden. Und außerdem sind alle Daten AES-256 verschlüsselt. Also perfekt zur Ablage in irgendeiner Cloud root@frank-MS-7C37:~# restic --password-file /root/passwd -r rclone:Nextcloud:HOME_UBUNTU backup --files-from /root/includes.txt repository 99xxxxa0 opened successfully, password is correct Files: 57 new, 41 changed, 3449 unmodified Dirs: 0 new, 2 changed, 0 unmodified Added to the repo: 22.941 MiB processed 3547 files, 21.137 GiB in 0:13 snapshot c6xxxxe4 saved Wie ihr seht, hat der zweite Durchgang nur ein paar neue und geänderte Daten gesichert. Der Rest ist ja schon vorhanden. Und das kann man dann auch problemlos täglich, wöchentlich oder was auch immer mal eben schnell durchführen. Eines meiner absoluten Lieblingstool
  • Upgrade auf NodeBB 1.11.0

    NodeBB nodebb linux
    1
    1
    0 Stimmen
    1 Beiträge
    411 Aufrufe
    Niemand hat geantwortet