Set up debian11 for grasswiki

[robe]

grasswiki is still on osgeo6 and eventually we will rebuild osgeo6. So makes sense to containerize this.

It looks like grasswiki uses wiki (wikimedia) and MySQL.

So I assume we can throw in debian10, latest MariaDB, PHP 7.4, and drupal and restore grasswiki files and backup on that.

[neteler]

Indeed grasswiki uses Mediawiki :)

​https://grasswiki.osgeo.org/wiki/Special:Version

[robe]

ah sorry not sure why I thought it was drupal. So we can configure it much the same as we did with the new wiki.osgeo.org - ​https://wiki.osgeo.org/wiki/SAC_Service_Status#wiki

[robe]

Milestone renamed

[robe]

Move these to next contract milestone

[robe]

I did start setting this up and upgraded to debian 11. Still need to pull over the data from osgeo6.

[neteler]

Thanks!

A question: grasswiki uses some Mediawiki extensions are not part of wiki.osgeo.org, is that an issue?

[robe]

It's on osgeo3 but in a separate container from wiki.osgeo.org, so not an issue at all. I did start off with an image of wiki.osgeo.org and dropped all the data and started copying over grasswiki stuff - detailed here - ​https://git.osgeo.org/gitea/sac/osgeo3/wiki/grass-wiki-IN-PROGRESS

But then got side tracked with other things. I'm hoping to upgrade it to debian 11 (bullseye) this week and finish restoring the wiki database and files, and try to upgrade to latest media-wiki.

If you want to try logging in, the server is on osgeo3 and called grass-wiki. I gave you sudo access

​https://wiki.osgeo.org/wiki/SAC_Service_Status#osgeo3

ssh neteler@osgeo3-grass-wiki

should get you in.

[neteler]

Thanks for your efforts, @robe!

I tried to login but it still asks for a pw:

ssh neteler@osgeo3-grass-wiki
(neteler@osgeo3-grass-wiki) Password: 

Extra wish: could you please also enable Martin Landa? (he installed it the grasswiki on osgeo6)

[robe]

Just type in your ldap password. I don't have ssh public keys check on the containers by default and have password access allowed (since they are protected from direct ssh anyway) I figured owners might want to lock them down. You can install your key after you log in first time.

You should be able to add Martin as sudo or let me know his username.

[robe]

FYI running into a little issue with restoring the mysql db.

Getting this error:

ERROR 1062 (23000) at line 393: Duplicate entry '4140' for key 'PRIMARY'

Looking at the number of tables restored:

with this query:

-- I have 11 tables restored

SELECT table_name, table_rows
   FROM INFORMATION_SCHEMA.TABLES
  WHERE TABLE_SCHEMA = 'grass_wiki'
ORDER BY table_name;

-- but osgeo6 has 58 rows

I suspect it crapped out at the hit_counter table since osgeo6 has 2943 rows and the restore has 0 for that table. I'm checking that table on osgeo6 to see if it has dupes.

[robe]

I see the record in the hit_counter table with page_id = 4140, but does not appear duplicated in osgeo6

[robe]

Okay resolved the issue. Must have been some sort of fragmentationin the hit_counter table.

Doing:

` use grass_wiki; optimize table hit_counter; `

and then redoing the backup and restore fixed the issue. So now counts look about the same in each database.

[neteler]

Replying to robe:

Just type in your ldap password.

Works, thanks.

You should be able to add Martin as sudo or let me know his username.

This is his account: ​https://id.osgeo.org/ldap/search?query=martinl

Glad you got the DB mess fixed!

[robe]

Okay martinl should be set to. I'm going to next create a staging.grasswiki.osgeo.org to point to this so we can do a final pass thru after I reset up and try to upgrade it to latest wiki. Then once we feel comfortable we can reload and do the repoint.

[robe]

I have ​https://staging.grasswiki.osgeo.org up but trying to troubleshoot why none of the pages are showing content. I haven't upgraded wikimedia yet.

[robe]

One of the causes of blank pages is the pcre changes ​https://www.mediawiki.org/wiki/Manual:Common_errors_and_symptoms#All_pages_have_no_content,_but_when_editing_a_page_the_wiki_text_is_there.

On osgeo6 we have php 7.0 and on new grass-wiki is running php 7.3, so I guess this means I have to upgrade before I can confirm things are working. As the version of mediawiki is 1.27.1 and latest stable is 1.37.

[robe]

Okay upgrading it to latest wikimedia (1.37.1) version made the pages reappear again. I had to put in the latest versions of the extensions and change most extensions except for the Polyglot one to the new standard wfLoadExtension( 'Pluinname' ); syntax. I still want to upgrade it to bullseye to make sure that works okay.

​https://staging.grasswiki.osgeo.org

Please take a look when you have the chance.

If all looks good I'll do a final cutover the of the user files and another snapshot of the db and upgrade of the database and repoint the domain. (I also needed to change the LocalSettings to have $wgServer = "​https://staging.grasswiki.osgeo.org"; so will need to change that when we go live.

[strk]

Ticket retargeted after milestone closed

[neteler]

There is still an error:

Error creating thumbnail: Unable to save thumbnail to destination

in several places. Would you mind to check the permissions?

[robe]

Okay will do. I still need to upgrade it too to debian11. Will do in a bit.

[robe]

@neteler. I did screw up when copying the images and fixed that, but that still didn't fix the issue even after resetting permissions to www-data:wwd-data -R of the images folder.

I finally commented out the line in LocalSettings.php

$wgTmpDirectory = "$IP/images/temp";

as was suggested here - ​https://www.mediawiki.org/wiki/Topic:Qmkwqlxoor706ddt

and those notices about can't write disappeared. Can you take another look and see if it looks all okay. I'm going to try next to dist upgrade it to debian 11.

[robe]

dist upgrade to debian 11 completed. Please take a look and if good I can recopy the database and files if needed and rerun the upgrade.

[robe]

@neteler just checking if you are ready to move yet to new vm?

Anything else I need to do. Want me to reload the files and database from osgeo6?

[neteler]

Replying to robe:

@neteler just checking if you are ready to move yet to new vm?

My call-for-checking ​https://lists.osgeo.org/pipermail/grass-user/2022-January/082791.html didn't yield any negative feedback. So I believe we are good.

Anything else I need to do. Want me to reload the files and database from osgeo6?

Yes, please re-sync the Wiki data and then switch the DNS entries.

May we have the old instance under a different URL still available for a short time to be sure we got all over? Thanks!

[robe]

sure I can put the old under a different url. Say old.grasswiki.osgeo.org

[robe]

okay done. I've removed the staging.grasswiki.osgeo.org dns entry

​https://grasswiki.osgeo.org is now pointing at new server on osgeo3 (grass-wiki)

​http://old.grasswiki.osgeo.org is pointing at old (osgeo6). I removed the old cert though and just changed to use the expired star osgeo.org cert, so you'll get a warning if you try the https path.

I'm going to close this ticket. Feel free to open if you still have issues.

[neteler]

One issue I discovered: we used to have this extension installed:

​https://www.mediawiki.org/wiki/Extension:Multilang (--> ​https://www.mediawiki.org/w/index.php?oldid=2043969)

which has been archived since then.

I wonder if we could migrate to ​https://www.mediawiki.org/wiki/Extension:MultiLanguageManager to not loose all the translated pages (however, the translations are not that fresh).

No strong opinion here...

[robe]

According to my install notes, looks like I did install MultiLanguageManager. Sorry I didn't mention that.

From my install notes here - ​https://git.osgeo.org/gitea/sac/osgeo3/wiki/grass-wiki

#extension used is MultiLang but that seems non-functional after 1.17 (so disable it)
wget https://extdist.wmflabs.org/dist/extensions/MultiLanguageManager-REL1_37-27ed4f6.tar.gz
tar -xzf MultiLanguageManager-REL1_37-27ed4f6.tar.gz -C /var/www/grass/grass-wiki/w/extensions

But it needs to be enabled in the LocalSettings.php file and I didn't do that since I wasn't sure what else needs to be done to use it.