Support S3 Compatible Storage

[griffithg]

Description (*)

As a site admin I would like to be able to use my S3 compatible storage (ex. MinIO) in the same way I use AWS S3 storage.

Expected behavior (*)

If I am using AWS S3 nothing changes. If I want to use S3 API compatible storage there would be a config option to provide a URL and a option to enable path style endpoints.

Benefits

It would give those of us hosting on-prem the ability to use the S3 compatible storage systems we already have available instead of going to AWS.

Additional information

From my testing it seems to come down to adding a couple config options to the factory and then working out the config options. Wasn't sure if this was on the roadmap internally. Should it be a separate module or an enhancement to the AwsS3 module.

[m2-assistant]

Hi @griffithg. Thank you for your report.
To help us process this issue please make sure that you provided the following information:

• Summary of the issue
• Information on your environment
• Steps to reproduce
• Expected and actual results

Please make sure that the issue is reproducible on the vanilla Magento instance following Steps to reproduce. To deploy vanilla Magento instance on our environment, please, add a comment to the issue:

@magento give me 2.4-develop instance - upcoming 2.4.x release

For more details, please, review the Magento Contributor Assistant documentation.

Please, add a comment to assign the issue: @magento I am working on this

---

• Join Magento Community Engineering Slack and ask your questions in #github channel.

⚠️ According to the Magento Contribution requirements, all issues must go through the Community Contributions Triage process. Community Contributions Triage is a public meeting.

🕙 You can find the schedule on the Magento Community Calendar page.

📞 The triage of issues happens in the queue order. If you want to speed up the delivery of your contribution, please join the Community Contributions Triage session to discuss the appropriate ticket.

🎥 You can find the recording of the previous Community Contributions Triage on the Magento Youtube Channel

✏️ Feel free to post questions/proposals/feedback related to the Community Contributions Triage process to the corresponding Slack Channel

[barryvdh]

It would basically be adding an optional endpoint config option (eg like in https://flysystem.thephpleague.com/v1/docs/adapter/digitalocean-spaces/ ) and an option to determine the url, right?

[griffithg]

Yes.
I was trying MinIO out by adding:
$config['endpoint'] = 'https://someurl';
$config['use_path_style_endpoint'] = true/false;
to createConfigured in AwsS3Factory.php

The second option is needed to allow for the use of url/bucket instead of bucket.url in environments where DNS can't be or isn't set for all the buckets.

Haven't gotten as far as adding config options yet. Mostly since they are defined in the Remote Storage module and wasn't sure where the more appropriate place to define the new options would be.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed after 14 days if no further activity occurs. Is this issue still relevant? If so, what is blocking it? Is there anything you can do to help move it forward? Thank you for your contributions!

[dverkade]

Open issues should not be closed automatically. Posting a comment here to remove the stale issue label.