Skip to content

OpenCloud - Minio Integration

Verschoben OpenCloud
2 1 122
  • Die Konfiguration zeigt einem aber auch immer schöne neue Sachen, die man unbedingt ausprobieren muss 🙂 Eines, wo ich beim Lesen der Konfiguration gestolpert bin, ist die Minio / S3 Integration. Wie praktisch, wenn man einen Minio-Server schon laufen hat.

    # S3 Storage configuration - optional
    # OpenCloud supports S3 storage as primary storage.
    # Per default, S3 storage is disabled and the decomposed storage driver is used.
    # To enable S3 storage, uncomment the following line and configure the S3 storage.
    # For more details see:
    # https://docs.opencloud.eu/docs/admin/configuration/storage-decomposeds3
    # Note: the leading colon is required to enable the service.
    DECOMPOSEDS3=:decomposeds3.yml
    # Configure the S3 storage endpoint. Defaults to "http://minio:9000" for testing purposes.
    DECOMPOSEDS3_ENDPOINT=https://minio.example.org
    # S3 region. Defaults to "default".
    DECOMPOSEDS3_REGION=default
    # S3 access key. Defaults to "opencloud"
    DECOMPOSEDS3_ACCESS_KEY=<ACCESS KEY>
    # S3 secret. Defaults to "opencloud-secret-key"
    DECOMPOSEDS3_SECRET_KEY=<SECRET KEY>
    # S3 bucket. Defaults to "opencloud"
    DECOMPOSEDS3_BUCKET=opencloud-bucket
    #
    # For testing purposes, add local minio S3 storage to the docker-compose file.
    # The leading colon is required to enable the service.
    #DECOMPOSEDS3_MINIO=:minio.yml
    # Minio domain. Defaults to "minio.opencloud.test".
    MINIO_DOMAIN=https://minio.example.org
    

    So, das ist die funktionierende Konfiguration. Bitte drauf achten, wie ihr Eure Minio Installation erreicht, meine Installation ist so aufgebaut das ich keine Ports brauche. Hatte am Anfang aber mit :9000 getestet. Das führte aber zu kaputten Files.

    069d1bf8-da52-4237-9c47-92f8168dfd42-image.png

    Rechts unten, bei der Eieruhr stand dann This item is in processing Das ging auch durch einen kompletter Neustart nicht weg.

    Also heute morgen mal bei den Entwicklern im Matrix Channel nachgefragt. Wenige Minuten später die Antwort. Danke schön dafür!

    Ab in die Bash des Containers.

    docker exec -it opencloud_full-opencloud-1 bash
    

    Dann hatte ich das hier eingegeben.

    ccca410bf52a:~$ opencloud storage-users uploads sessions
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset  |  Size   |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       |  848052 |  848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |         |         |                                      |                                      |                      |            |                      |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2c96a3f3-10f3-4490-a3d1-05c2c013c030 | New file.txt                   |       9 |       9 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:49Z | true       | 0001-01-01T00:00:00Z |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | c3a75ec3-610b-4601-b839-fe109eeea53f | Delta Force   20.12.2024       | 1771546 | 1771546 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:06:48Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 17_25_21.png                   |         |         |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions --resume
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset  |  Size   |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       |  848052 |  848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |         |         |                                      |                                      |                      |            |                      |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2c96a3f3-10f3-4490-a3d1-05c2c013c030 | New file.txt                   |       9 |       9 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:49Z | true       | 0001-01-01T00:00:00Z |             |
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | c3a75ec3-610b-4601-b839-fe109eeea53f | Delta Force   20.12.2024       | 1771546 | 1771546 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:06:48Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 17_25_21.png                   |         |         |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+---------+---------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions --resume
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset |  Size  |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       | 848052 | 848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |        |        |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset |  Size  |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       | 848052 | 848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |        |        |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    ccca410bf52a:~$ opencloud storage-users uploads sessions --restart
    Sessions:
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    |                Space                 |              Upload Id               |              Name              | Offset |  Size  |              Executant               |                Owner                 |       Expires        | Processing |      Scan Date       | Scan Result |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 008e8ab1-6841-4e2a-8cf4-178c7220aefb | Delta Force   20.12.2024       | 848052 | 848052 | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2b5892f1-6110-4a8c-a86c-b743d85db6da | 2025-05-31T07:01:03Z | true       | 0001-01-01T00:00:00Z |             |
    |                                      |                                      | 16_59_27.png                   |        |        |                                      |                                      |                      |            |                      |             |
    +--------------------------------------+--------------------------------------+--------------------------------+--------+--------+--------------------------------------+--------------------------------------+----------------------+------------+----------------------+-------------+
    

    Das war die Antwort

    You can run opencloud storage-users uploads sessions to see the queue
    opencloud storage-users uploads sessions --resume repeats the previous step
    opencloud storage-users uploads sessions --restart restarts the whole process
    But please make sure that your S3 config is working
    Another issue can occur, when you have clamav and the virusscanner is not responding

    opencloud storage-users uploads sessions # see the queue
    opencloud storage-users uploads sessions --resume # repeats the previous step
    opencloud storage-users uploads sessions --restart # restarts the whole process
    

    Danach hatte ich die drei hängenden Files wieder ordentlich.

    Tipp, schön drauf achten, dass man die richtigen Zugangsdaten anwendet 🙂

    Und jetzt werde ich das mal die nächsten Tage testen.

  • FrankMF FrankM verschob dieses Thema von Linux
  • Ich habe das wieder abgeschaltet, da es in meinem Setup zu viel der schnellen Oberfläche kaputt macht. Beide Installationen als VMs bei Hetzner. Da bleibe ich für meinen Fall, soll sowieso nur für mich und evtl. ein paar Familienmitglieder sein, bei der lokalen Speicherung. Das ist schneller und fühlt sich einfach besser an 😉

  • 0 Stimmen
    1 Beiträge
    18 Aufrufe
    Niemand hat geantwortet
  • Nextcloud - Update auf 30.0.1

    Nextcloud nextcloud linux
    1
    0 Stimmen
    1 Beiträge
    236 Aufrufe
    Niemand hat geantwortet
  • Rest-Server v0.13.0 released

    Restic rest-server restic linux
    2
    0 Stimmen
    2 Beiträge
    400 Aufrufe
    FrankMF
    Download Rest-Server und installieren Im Github Repository den aktuellen Release suchen. Hier am Beispiel der aktuellen Version 0.13.0 (27.07.2024) Datei herunterladen wget https://github.com/restic/rest-server/releases/download/v0.13.0/rest-server_0.13.0_linux_amd64.tar.gz Die Datei entpacken tar -xf rest-server_0.13.0_linux_amd64.tar.gz Ins Verzeichnis wechseln cd rest-server_0.13.0_linux_amd64 Wenn der Rest-Server läuft, dann muss man diesen erst mal stoppen. systemctl stop rest-server Danach kopiert man das File nach bin. Wer mag sichert vorher das alte File. cp rest-server /usr/local/bin Danach kann man den Rest-Server wieder starten. systemctl start rest-server Versionskontrolle root@rest-server:~# rest-server -v rest-server version rest-server 0.13.0 compiled with go1.22.5 on linux/amd64 Die Hilfe vom Rest-Server root@rest-server:~# rest-server -h Run a REST server for use with restic Usage: rest-server [flags] Flags: --append-only enable append only mode --cpu-profile string write CPU profile to file --debug output debug messages -h, --help help for rest-server --htpasswd-file string location of .htpasswd file (default: "<data directory>/.htpasswd)" --listen string listen address (default ":8000") --log filename write HTTP requests in the combined log format to the specified filename (use "-" for logging to stdout) --max-size int the maximum size of the repository in bytes --no-auth disable .htpasswd authentication --no-verify-upload do not verify the integrity of uploaded data. DO NOT enable unless the rest-server runs on a very low-power device --path string data directory (default "/tmp/restic") --private-repos users can only access their private repo --prometheus enable Prometheus metrics --prometheus-no-auth disable auth for Prometheus /metrics endpoint --tls turn on TLS support --tls-cert string TLS certificate path --tls-key string TLS key path -v, --version version for rest-server Systemd Wer noch ein passendes systemd File benötigt. [Unit] Description=Rest Server After=syslog.target After=network.target [Service] Type=simple User=rest-server Group=rest-server ExecStart=/usr/local/bin/rest-server --private-repos --tls --tls-cert /mnt/rest-server/<DOMAIN>/fullchain.pem --tls-key /mnt/rest-server/<DOMAIN>/key.pem --path /mnt/rest-server Restart=always RestartSec=5 # Optional security enhancements NoNewPrivileges=yes PrivateTmp=yes ProtectSystem=strict ProtectHome=yes ReadWritePaths=/mnt/rest-server [Install] WantedBy=multi-user.target
  • Debian 10.4 released und Wireguard kaputt :(

    Linux linux wireguard
    1
    0 Stimmen
    1 Beiträge
    283 Aufrufe
    Niemand hat geantwortet
  • SSH sign_and_send_pubkey: signing failed: agent refused operation

    Linux linux
    1
    1 Stimmen
    1 Beiträge
    272 Aufrufe
    Niemand hat geantwortet
  • Debian Buster 10 Release

    Linux linux nvidia
    3
    1
    0 Stimmen
    3 Beiträge
    464 Aufrufe
    FrankMF
    Da man ja beim Login auswählen kann, mit was die Session startet, war ich doch jetzt etwas neugierig was überhaupt läuft. [image: 1562484643462-img_20190707_092217.jpg] frank@debian:~$ echo $WAYLAND_DISPLAY frank@debian:~$ loginctl SESSION UID USER SEAT TTY 7 1000 frank seat0 tty2 c1 116 Debian-gdm seat0 tty1 2 sessions listed. frank@debian:~$ loginctl show-session c1 -p Type Type=x11 frank@debian:~$ loginctl show-session c1 Id=c1 User=116 Name=Debian-gdm Timestamp=Sat 2019-07-06 22:43:34 CEST TimestampMonotonic=30094837 VTNr=1 Seat=seat0 TTY=tty1 Remote=no Service=gdm-launch-environment Scope=session-c1.scope Leader=1015 Audit=4294967295 Type=x11 Class=greeter Active=no State=online IdleHint=yes IdleSinceHint=1562446130937731 IdleSinceHintMonotonic=346278596 LockedHint=yes Die Installation der Nvidia Treiber macht da wohl einen x11 Desktop raus. Aber auch nicht weiter schlimm, der Wayland lief ja hier überhaupt nicht. Würde mich aber über interessante Links zum Thema freuen
  • NodeBB - spawn npm ENOENT

    NodeBB nodebb linux
    1
    0 Stimmen
    1 Beiträge
    446 Aufrufe
    Niemand hat geantwortet
  • Restic - Ein Backupkonzept

    Angeheftet Restic linux restic
    1
    0 Stimmen
    1 Beiträge
    1k Aufrufe
    Niemand hat geantwortet