Why does 25% of my donation go to Amazon

Cloud hosting, as explained here, is only used for S3 storage, which is a fancy way of saying “hard drives”. That’s a 25% of estimated 2023 yearly low-budget. This sounds insane to me. It’s hard for me to believe that 25% of my donation money went straight to Amazon.

Correction: The OSMF budget is not the operations budget. The highest case AWS in the budget is 3% of the OSMF budget. - but the total 25k euro remains nonetheless.

I wanted to better understand, what’s exactly being stored on those S3. This information is quite difficult to find, and it accounts for a substantial amount of money. I have only been able to find this post, which indicates that at some point, we stored 86TB in Fastly logs - i - n - s - a - n - e. I know it’s no longer the case but this does not boast well for the remaining kinds of data stored there.

It also sounds like the backups we produce are complete - not incremental. I cannot say for sure, but if that’s the case, I would be worried about the competence of some people. I am really struggling here to justify the 25k yearly spending, sorry if that’s not the case and I offended someone.

The biggest reasonable data store for OSM I can think of, is the full history planet file, which weighs about 200GB. Multiple it a few times and I think OSM should not need more than 100TB in storage - ever. This is easily achievable with own hardware. It’s worth noting that after this huge 25k Euro yearly spending, OSM still does not own the S3 hardware, it’s just renting it out. It could have easily been a one time spending (+small yearly maintenance).

I am also concerned as to how much dependency does OSM have on Amazon, a big tech. We have all these servers. Why do we ruin this now for some S3. We could as well host it on Google Cloud and it would be no differ, I thought OSM wants to fight with big tech and stay independent.

I know there will be an argument about how sending data also costs, not just storing it. My answer to that is: use the fricking CDN for that. That’s the whole point of a CDN - to send out data, so we don’t have to. When we use a sponsored/free CDN, we only have to pay for storing the data pretty much.

Literally OSM in 2022, 2023:

I am personally tired of people who want to use the cloud for everything. Such individuals really seem to love living under indefinite subscriptions and not owning anything. I don’t and nor should OSM.

10 posts - 4 participants

Read full topic

Ce sujet de discussion accompagne la publication sur https://community.openstreetmap.org/t/why-does-25-of-my-donation-go-to-amazon/102475