Discussion for Future of diasp.in
We plan to discuss the future of diasp.in today at 7 PM on the sideline of DebCamp23, as most people are present here. Venue would be noisy hacklab on 2nd floor.
Points we want to discuss:
i) if keeping around is worthwhile
ii) maintainer ship + sponsorship. For now it cost around 3500 INR/month which is borne co-borne by rajudev and me. Also we have domain cost. Last renewal was sponsored by abbyck
iii) we are also considering sunsetting the service with 31st Dec end period.
TODO list
-
website homepage (big banner)
-
✔️
with a dedicate page
-
Personal accounts (praveen)
-
✔️
FSCI rooms
-
✔️
-
FSCI blog
-
diasp.in diaspora
-
IB computing
-
FOSSUnited
-
ILUGs
-
✔️
NSS Palakkad
-
VGLUG
-
DAKF
-
SMC blog
-
header on diaspora every page
-
send to all synapse and prosody users if possible
-
also to all diaspora users
Poll Created Tue 21 Nov 2023 3:47PM
Would you like to keep matrix synapse running? Closed Fri 15 Dec 2023 3:00PM
Abhas has volunteered to keep matrix service running. If we are able to get a new server setup before the deadline of Jan 31st 2024 (ideally Jan 10th or something to allow for migration), we will keep it running.
What is the team, working group or event you are inviting people to?
We currently run xmpp, matrix and diaspora services. Of these, xmpp I'd like to keep and diaspora, I have some sentimetal attachment and would like to wait a bit more (1-2 years, I have invested so much time already, so would like to wait a bit more) and see if they release 1.0 with api support.
We start the whole community hosting and also debian packaging with diaspora. We do run a pirate irc to matrix bridge, we can try to relocate it to poddery.com if they agree or drop it as well. If no one steps in by the poll closing, we will give a 3 month notice and shut it down.
Why is this important?
Unless someone wants to keep matrix, dropping this service will help reduce the system requirements and cost a lot.
What are you asking people to do?
So if you'd like to keep it running, step in now.
Select 'Accept' to participate!
Results
Results | Option | Voters | |||
---|---|---|---|---|---|
|
Accept | 1 | |||
|
Decline | 5 | |||
|
Undecided | 40 |
6 of 46 people have participated (13%)
Pirate Praveen
Tue 21 Nov 2023 3:47PM
We have been trying to reduce the disk usage for last few days and seems this is too much to handle.
weepingclown
Tue 21 Nov 2023 3:47PM
This could help in cutting down the disk usage and hence server costs, as well as reducing maintenance difficulties. At the moment when we are still lacking enough people to manage everything, it looks like the better decision to let go of hosting matrix.
Akshay
Tue 21 Nov 2023 3:47PM
With the storage requirement it is impossible to maintain. But if we decide to shut it down I want to experiment migrating to dendrite with the script mentioned at end of https://github.com/matrix-org/dendrite/issues/1705 which is https://github.com/Saimo/synapse-dendrite-migration and see if dendrite can run with lower resources
Pirate Praveen Wed 22 Nov 2023 7:14AM
@Akshay we could keep the db dump and media for a bit longer, if we find someone with enough storage, just in case someone wants to resurrect it later. I have some 500GB free rsync.net account which I can spare if that is well below 500GB (keeping some space for my personal usage). The home server itself people can easily migrate, but the pirate irc bridge is a unique value (irc v3 on the other side, none of the matrix.org bridged irc rooms are on irc v3 yet I guess), even if the number of users is less.
Karthik
Wed 22 Nov 2023 4:38AM
Let's drop
Abhas Abhinav
Wed 22 Nov 2023 9:00AM
Would be glad to migrate and help maintain the matrix server and associated bridges. I can either do this on one of the bare metal servers that we have. Or use a new server for this.
Pirate Praveen Wed 22 Nov 2023 2:26PM
@Abhas Abhinav thanks. Currently the authentication is done with https://git.fosscommunity.in/necessary129/synapse-diaspora-auth against the diaspora database. If we are moving synapse to a different machine, we will have to setup an SSH tunnel or something to have it authenticate against the diaspora database. Or move diaspora+matrix+xmpp together if you are ok with hosting those too.
Abhas Abhinav Thu 23 Nov 2023 5:29AM
@praveenarimbrathod Hosting diaspora and xmpp together with matrix is not an issue.
However, how about migrating the authentication to an independent service?
This could be done with OpenLDAP, or even a database. On top of this authentication database, we could build a SSO service such as Keycloak (or Authentik). That way all applications could off-load authentication to SSO and user's get single sign-on convenience and functionality for free.
In future, other community-maintained websites and applications could re-use this SSO system (via OpenID Connect etc.) for easier roll out to the all free-software community members.
Pirate Praveen Thu 23 Nov 2023 7:28AM
@Abhas Abhinav diaspora don't support openldap. If we can have keyclock (or authentik) in front of diaspora db, that is fine too. I think it is better to migrate the current setup first and work on this in parallel else migration will take longer.
Pirate Praveen Sun 26 Nov 2023 10:11AM
@Abhas Abhinav when can we get access to the server so we can plan the server migration.
Abhas Abhinav Thu 30 Nov 2023 4:06AM
@praveenarimbrathod
Sorry for the delay. I will provision and give access to the new server today. Where can I get access to SSH keys to be added for root access to the server?
Would the following config be good?
Bare metal server at OVH Mumbai
Intel Xeon-E 2386G - 6c/12t - 3.5GHz/4.7GHz
32GB RAM
4TB x 2 SATA OR 500GB NVME x2 (Software RAID 1)
There is a significant discount for commiting to use the server for 24 months. I have chosen that option. Hope that looks good.
Pirate Praveen Thu 30 Nov 2023 7:36AM
@Abhas Abhinav This looks fine to me. We will need to with the SATA option as we will need more than 500 GB storage. My ssh keys ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIRp1HLd/jhH8t1OE0A950ml1nCLh3ryELpD1wqJKZgV pravi@ilvala2
Hopefully others will share their keys as well. Can we take a disk dump and restore? That will be the easiest method. Hetzner has a recovery mode which we can use, hopefully OVH will have something similar.
Pirate Praveen Wed 20 Dec 2023 8:51PM
@Abhas Abhinav can we get it by Jan 10th? I think only then we will have enough time to migrate to the new server before Jan 31st deadline set by current server sponsors.
Pirate Praveen Mon 8 Jan 2024 2:35PM
@Abhas Abhinav Did you get the server already? Or should we drop the matrix plan? We are running out of time till the current sponsors have committed to pay - they are going to pay only till January 31st.
Pirate Praveen Mon 8 Jan 2024 2:37PM
Since we don't have access to the server promised by @Abhas Abhinav yet, I'm not sure if we can do the matrix migration by January 31st.
Pirate Praveen Wed 17 Jan 2024 3:31PM
Meeting now at https://meet.nixnet.services/b/pir-akd-3vx as announced on the matrix group earlier.
Pirate Praveen Wed 17 Jan 2024 7:24PM
From today's meeting: We will drop synapse behind (Since Abhas was the only person interested to keep it and he is not reachable/responding for over a month and half and deadline for migration is fast approaching) and move to infomaniak public cloud with just diaspora and prosody.
Pirate Praveen Thu 25 Jan 2024 11:59AM
We are now running on the new Infomaniak public cloud server. See https://gitlab.com/piratemovin/diasp.in/-/issues/67 for the issues. Thanks a lot to @weepingclown who did most of the work. Thanks also to @Pirate Bady , @Athul , Suhail, deadman and everyone else who helped. Thanks also to @sahilister and @Raju Devidas for maintaining it till now and also to @Dhanesh , @Pirate Vik and others who were maintaining it before. We should create a credits page and list all the people who contributed so far. If anyone wants to keep the synapse and pirateirc bridge db and configs till the Infomaniak offer of 300 Euro for 3 months remains valid, that would be great, so @Abhas Abhinav or anyone else feels like resuming matrix during that period can do it.
With this migration hosting charges are down to ~1000 INR (we will know exact amount later as we are using more resources than we need right now for initial setup).
Pirate Praveen Thu 1 Feb 2024 2:25PM
Thanks to Akhil Varkey, we have taken an sql dump of synapse db. We will keep it till the free 300 credits from Infomaniak lasts (3 months). @Abhas Abhinav if you are still interested (or if anyone else is interested) to continue running the matrix service, you can use this option.
Pirate Praveen Mon 20 May 2024 1:20PM
I have deleted the synapse backup today as free credits are over. @weepingclown please share the monthly expenses so we can find people to donate.
Poll Created Thu 25 Jan 2024 12:32PM
Would you like to keep diaspora service running? Closed Wed 28 Feb 2024 12:00PM
Since no one stepped in to maintain diaspora yet, we will be shutting it down eventually. Since we need diaspora for new sign ups, we will keep it running until we can move the sign ups to xmpp. We will keep the data a bit longer in case people want to down load their data.
What is the team, working group or event you are inviting people to?
Would you like to continue maintaining diaspora service? I did not want too much disruption in this move since XMPP sign ups are also handled by diaspora. So before dropping diaspora, we have to enable direct sign ups with XMPP - @Akshay thinks this would be easy as current prosody diaspora auth is a modified version of SQL auth module which we can use to authenticate against an SQL table (currently we use to only read, but this could used to write as well).
Why is this important?
diaspora pods are not many and keeping it running would give people a chance to try out diaspora. Though the diaspora development is very very slow and next major version with API support and pod migration will take a while to get released.
What are you asking people to do?
I'm not personally motivated to keep it running (though I'd like to export the current public data - something like how debconf site is archived every year using django bakery, if we can find something similar in rails or just export the interesting accounts like https://diasp.in/u/poddery which has some interesting history). If you'd like to continue maintaining diaspora please step in now. You will need to make sure it is updated and we are keeping the spam sign ups in check etc.
Select 'Accept' to participate!
Results
Results | Option | Voters | |||
---|---|---|---|---|---|
Accept | 0 | ||||
|
Decline | 1 | |||
|
Undecided | 45 |
1 of 46 people have participated (2%)
Pirate Praveen
Thu 25 Jan 2024 12:32PM
I have been solo pushing to keep this, but I don't want to keep it running alone anymore.
Akshay Thu 25 Jan 2024 2:26PM
There's great advantage in deleting/simplification. Makes life a lot easy. Allows one to focus on the things that really matter, etc. I support dropping diaspora (just like dropping matrix).
But preserving links by making a static dump would be awesome.
Pirate Praveen Wed 7 Feb 2024 1:46PM
@Akshay https://stackoverflow.com/questions/17412199/export-static-htmlcssjs-from-rails there is a gem for this https://middlemanapp.com/ or we could get wget dump with https://diasp.in/public (which could include spam) so may be just the public profiles we want diasp.in/u/<username>
Poll Created Tue 5 Mar 2024 5:48PM
Update diasp.in homepage to mention diaspora service will be shutting down Closed Wed 10 Jul 2024 2:00PM
This was included in the diasp.in homepage redesign by Advaith Narayanan and Amal Babu
What is the team, working group or event you are inviting people to?
Looking for volunteers to update the homepage and add a top banner announcing shutting down of diaspora service as soon as we are able to setup new accounts creation via XMPP.
Update: We now have a new Hetzner Cloud account and registered durare.org. We will soon be able to offer new accounts via durare.org (Status: https://gitlab.com/piratemovin/diasp.in/-/issues/87). So we will shutdown diaspora service on July 31st (to avoid paying for two servers). We can keep a snapshot of the server for another month in case someone wants to request data.
Why is this important?
We need to notify our users that diaspora service will stop working from August 1st.
What are you asking people to do?
Update the website with a banner.
Select 'Accept' to participate!
Results
Results | Option | Voters | |||
---|---|---|---|---|---|
Accept | 0 | ||||
Decline | 0 | ||||
|
Undecided | 46 |
0 of 46 people have participated (0%)
Buster Keaton Sun 18 Aug 2024 7:48PM
One more step towards the future.
Beta testing of XMPP accounts at durare.org is now open!
Pirate Praveen · Fri 13 Oct 2023 7:23PM
I talked to @Manu Krishnan T V tonight and he has agreed to provide space for backup (server without direct ipv4 address, but should be enough to run rdiff-backup).