Setup picture gallery to replace flickr

[robe]

I set up an lxd container on osgeo3 called gallery which will hopefully be new home for our past flickr pictures.

Brian Hamlin has script pulling the pictures from flickr and spearheading the setup.

What is being setup is prism a photo gallery app written in golang - ​https://github.com/photoprism/photoprism

Once it's ready for prime time, we'll expose as gallery.osgeo.org which apparently is a domain that once existed as it seems to resolve to 140.211.15.68 (got to check what that was)

[neteler]

Replying to robe:

Once it's ready for prime time, we'll expose as gallery.osgeo.org which apparently is a domain that once existed as it seems to resolve to 140.211.15.68 (got to check what that was)

It was a kind of user story gallery, see here: ​https://web.archive.org/web/20091223033534/http://gallery.osgeo.org:80/

[robe]

okay found remnants of old gallery on old-webextra container. It was only in available sites and not in enabled, so assume it's been dead for a while. Repointing that now to osgeo4.

Looks like it was somesort of django app and I see a bunch of pictures from it in osgeo7-old-webextra - /var/www/gallery/old/gallery-site

[robe]

We are still working on pulling the picks but repointed gallery

​https://gallery.osgeo.org/

so it's now using the photoprism thing. We are still working out how all this works.

[robe]

adding notes from -- ​https://lists.osgeo.org/pipermail/sac/2022-August/014526.html

---

Dear SAC members,

during FOSS4G 2022 we collected several pictures that we would like to share with the community. Before flick was used but now the license changed and it is not possible anymore.

Could be possible to set up a service to share these photos. I found few possible candidates:

• Nextcloud (OSGeo already have a running instance)
• Piwigo ​https://piwigo.org/
• LibrePhoto ​https://github.com/LibrePhotos/librephotos
• Lychee ​https://github.com/LycheeOrg/Lychee

I would like to have any feedback from your side.

Thanks a lot

-- ciao Luca

---

As a note we did setup ​https://nextcloud.gallery.osgeo.org with plans to store photos there. Not sure how far that got.

[strk]

​https://pixelfed.org/ is also to be considered

[robe]

Replying to strk:

​https://pixelfed.org/ is also to be considered

Looks like repo here. ​https://github.com/pixelfed/pixelfed

Has anyone tried this one and have an opinion?

At a glance looks like it has

1) Supports LDAP integration

​https://docs.pixelfed.org/running-pixelfed/optional-features/ldap-authentication/

2) Supports PostgreSQL

​https://docs.pixelfed.org/running-pixelfed/prerequisites/

3) allows for federation, I assume that is why it's called Fed

[robe]

I'm going to start working on a new server for this and hopefully I will succeed.

Luca,

Once I have it set up, I'll let you know so you can start uploading the FOSS4G photos.

[lucadelu]

Replying to robe:

I'm going to start working on a new server for this and hopefully I will succeed.

Luca,

Once I have it set up, I'll let you know so you can start uploading the FOSS4G photos.

Ok, I'm a little bit worried because pixelfed seems one-man-show project.

Thanks for your support Luca

[darkblueb]

stage one flickr project contents

gallery:/home/shared/OSGeo/flickr_works$ ls -F
'1990381@N20.info'           d0_lastzero/       flickcurl_dl_group.sh*        grp_osgeonl/
'2244553@N22.info'           d_agnesoli/        flickcurl_dl_set.sh*          grp_osgeopt/
'2728498@N23.info'           d_astrid/          flickcurl_getInfo_group.sh*   grp_photos_info2.csv*
'2747640@N22.info'           d_ebatty/          flickcurl_help.txt            grp_qgissc/
'2840621@N22.info'           d_gstein/          flickcurl_man.txt             lic_texts.csv
'2926401@N22.info'           d_jodygarnett/     g_eu/                         mmtrackoutRR.txt
'2943065@N20.info'           d_justb4/          g_osgeo/                      oHBjfx.html
'3522675@N24.info'           d_mloskot/         grp_ec15/                     olic_groups.csv
'3720585@N20.info'           d_msilikale0/      grp_foss4geu/                 osgeo_pics_lic.csv
'697379@N25.info'            d_ominiverdi/      grp_foss4g_ko14/              pinfo_rsing.txt
 a2020.txt                   d_ortelius/        grp_foss4gna/                 py2_misc/
 alb_foss4g15ko/             d_osgeo/           grp_foss4gna18/               some_lic_counts.txt
 alb_foss4g2008_costa/       downloads/         grp_ko15/                     test0.txt
 alb_foss4g2008_crschmidt/   d_rajsingh/        grp_osgeo/
 alb_fossgis16/              d_spatialguru/     grp_osgeolive/
 backup_flickr.py            d_stevenfeldman/   grp_osgeo_nl/

[robe]

I'm still working on setting this up.

I have it here:

​https://photo.osgeo.org

but troubleshooting why the ldap integration isn't working

[strk]

I've created a ​https://wiki.osgeo.org/wiki/Gallery page with what we had in ​https://wiki.osgeo.org/wiki/SAC_Service_Status#gallery

Regina I think that's the place to document what we have

[robe]

Okay I created a new entry after -- ​https://wiki.osgeo.org/wiki/SAC_Service_Status#pixelfed

We can decide later how to document what we have. I'm not using the current gallery since it has a lot of scraping tools and extra stuff. Once it's set up, we can migrate the photos over to pixelfed

[robe]

Update I have ldap working, but still some kinks to work out.

You should be able to log in ​https://photo.osgeo.org using the email address you have registered with your osgeo account.

The issues uncovered, thanks Brian Hamlin for testing :)

1) Admin mode, seems to require another password, I think it's probably an outstanding ldap issue, cause LDAP is pretty new feature on pixelfed

2) Mail is not sending

3) When you like a post or follow someone, that doesn't seem to work

Replying to lucadelu:

Replying to robe:

I'm going to start working on a new server for this and hopefully I will succeed.

Luca,

Once I have it set up, I'll let you know so you can start uploading the FOSS4G photos.

Ok, I'm a little bit worried because pixelfed seems one-man-show project.

Thanks for your support Luca

Yah I'm a bit concerned about that too and the fact it has not reached 1.0, but does have over 100 contributors which looks promising, and jsanz has used it and liked it.

Nextcloud is still on the table -- the most mature of all (and we have already running with LDAP/Postgres etc), but I feel it does too much so you'd get lost trying to find the photos.

​https://github.com/LycheeOrg/Lychee - This one looks good, sports PHP 8, supports PostgreSQL. It uses a lot of the same dependencies as pixelfed (and is Laravel based just like pixelfed), so if pixelfed doesn't pan out, Lychee would be my next bet, since I can easily reuse all the setup I did for pixelfed. It however doesn't seem to have LDAP support, but since it's laravel based, I can probably inject LDAP in there. The work pixelfed did for LDAP was mostly just requiring the laravel ldap plugin and still required some manual change of code to work.

​https://github.com/LibrePhotos/librephotos looks good - has some compelling features I don't see in the others, supports PostgreSQL, offers a docker container. Cons: Seems to lack LDAP support and it too appears to be a 1 man show.

​https://github.com/Piwigo/Piwigo -things I don't like about it: lacks LDAP support, is MySQL based, feels kind of old given they are focussed on PHP 5 and 7 with not even a mention of 7.3 or 7.4 on the plus not a one man show and has been around for a while.

[lucadelu]

Replying to robe:

Update I have ldap working, but still some kinks to work out.

You should be able to log in ​https://photo.osgeo.org using the email address you have registered with your osgeo account.

The issues uncovered, thanks Brian Hamlin for testing :)

1) Admin mode, seems to require another password, I think it's probably an outstanding ldap issue, cause LDAP is pretty new feature on pixelfed

2) Mail is not sending

3) When you like a post or follow someone, that doesn't seem to work

I did some test, I can confirm 3 and also I was not able to add any image to a collection.

Yah I'm a bit concerned about that too and the fact it has not reached 1.0, but does have over 100 contributors which looks promising, and jsanz has used it and liked it.

yes I agree, however it looks like a social network more than a service to share images

Nextcloud is still on the table -- the most mature of all (and we have already running with LDAP/Postgres etc), but I feel it does too much so you'd get lost trying to find the photos.

I would like to give him a chance, it is already working in OSGeo infrastructure, it seems that is it possible to connect different folder. It's quite simple to use, I don't know how could be improved for visualization, there could be some app to test

[robe]

Replying to lucadelu:

Replying to robe:

Nextcloud is still on the table -- the most mature of all (and we have already running with LDAP/Postgres etc), but I feel it does too much so you'd get lost trying to find the photos.

I would like to give him a chance, it is already working in OSGeo infrastructure, it seems that is it possible to connect different folder. It's quite simple to use, I don't know how could be improved for visualization, there could be some app to test.

Luca -- so we have two instances

​https://nextcloud.gallery.osgeo.org (on osgeo3 but it's older and needs updating)

​https://nextcloud.osgeo.org #this one is a little slow cause we are having network issues with osgeo7, which hopefully will be resolved once the new OSUOSL LinkOregon line is in place.

Can you upload some of the foss4g photos to one and see how you like it. You should be able to get in fine with your osgeo account on both. Both instances have over 500GB of space.

[robe]

Oh another list of options was mentioned on osgeo sac

​https://docs.librephotos.com/2/features/

[robe]

@lucadelu -- I went back to the work darkblueb did with photoprism and scraping all those pictures, great work Brian :)

Photoprism is the best photo gallery wise I think, however the user management is very immature. Only allows one user. I'm still trying to figure out how to make display public without logging in.

However I discovered it does have a webdav interface so I created a group folder called photoprism-sync on our ​https://nextcloud.osgeo.org.

I've just added you as a user of that folder, so you should see the folder, in your home folder when you log into nextcloud. Can you create a folder in that group folder for the pictures you have and throw all of them in.

I did a test run and did see photoprism pick them up.

[lucadelu]

Replying to robe:

@lucadelu -- I went back to the work darkblueb did with photoprism and scraping all those pictures, great work Brian :)

Ok

However I discovered it does have a webdav interface so I created a group folder called photoprism-sync on our ​https://nextcloud.osgeo.org.

created a FOSS4G 2022 folder and added some photos.

I've just added you as a user of that folder, so you should see the folder, in your home folder when you log into nextcloud. Can you create a folder in that group folder for the pictures you have and throw all of them in.

I would like to ask people taking photos to request OSGeo LDAP account and insert the images their self in that directory? If you want I can manage their permission on the folder. I already share with @jody, @cvvergara and others from the FLOC

I did a test run and did see photoprism pick them up.

Where I can find it?

[robe]

I see the folder you put up.

Here is the public share for it -- ​https://photoprism.osgeo.org/s/51ta2lrg3q/ari13vr2c43v5n9n

It seems with photoprism there is no way to share the whole list of albums etc, without allowing complete public/edit access. But each folder has a public share.

I'll send you credentials by email so you can take a look at the other stuff too.

[lucadelu]

Replying to robe:

I see the folder you put up.

Here is the public share for it -- ​https://photoprism.osgeo.org/s/51ta2lrg3q/ari13vr2c43v5n9n

It seems with photoprism there is no way to share the whole list of albums etc, without allowing complete public/edit access. But each folder has a public share.

ok, I think this is not a big problem...

could we think Nextcloud+Photoprism is the "final decision"? so we can start to upload FOSS4G 2022 images

[robe]

Replying to lucadelu:

Replying to robe:

I see the folder you put up.

Here is the public share for it -- ​https://photoprism.osgeo.org/s/51ta2lrg3q/ari13vr2c43v5n9n

It seems with photoprism there is no way to share the whole list of albums etc, without allowing complete public/edit access. But each folder has a public share.

ok, I think this is not a big problem...

could we think Nextcloud+Photoprism is the "final decision"? so we can start to upload FOSS4G 2022 images

Yes lets do that and see how it goes.

[lucadelu]

I found few problems with PhotoPrism:

• we created two subfolders in the ​FOSS4G 2022 folder but they are not shown in the ​PhotoPrism

• someone is loading a lot of image not related (at least it seems not related) to OSGeo, @robe could you check it ​here

• there are some ​hidden images, but I don't understand which are and how to find them

could someone help me specially with the first point because we would like to show the pictures in the two folders to the sponsors

[robe]

photoprism treats each folder separately even if a subfolder, so a bit annoying that way. So if you created a separate folder it ends up being a different album.

Those other hidden images you see are those I loaded from flickr albums, I do see some must have been mixed in that shouldn't be there perhaps taken with same camera.

I'll check on what happened to these folders you loaded.

[robe]

I'm running into some issues with this, so I think I'll need to rebuild it and maybe this time around just link the nextcloud images in and worry about the others later. I'll let you know once i have in place

[robe]

Okay I have it back up flashed to a point in time before I loaded those other random albums.

When I checked the logs it shows it synched nextcloud and I could see the B2B folders in the logs. However they still aren't showing up in folder list.

I'm beginning to suspect maybe the spaces in the FOSS4G 2022 is causing issues or some other oddness. That I haven't pinned down yet.

I also moved photoprism to osgeo7 now that the network speed is much better.

[robe]

Bah they just showed up. Maybe there is heavy caching on the screen or maybe my triggering reindex did something

So here they are:

​https://photoprism.osgeo.org/s/2wwnm15f4d/photoprism-sync-foss4g-2022-sponsors

​https://photoprism.osgeo.org/s/1nq4jckxj0/photoprism-sync-foss4g-2022-b2b

​https://photoprism.osgeo.org/s/51ta2lrg3q/photoprism-sync-foss4g-2022

Can you upload some more pictures and add more folders so we can see if it does the right thing on it's own.

I have it set to synch once an hour.

[lucadelu]

Some pictures has been uploaded correctly, others should arrive. I'm closing the ticket, if something will happen again I'll reopen it

[lucadelu]

Some days ago I moved some pictures from a folder to the main directory of FOSS4G but Photoprism didn't update yet.

[robe]

hmm I presume the UNI folder? since I don't see that in nextcloud anymore.

It says the sync is up to date, but maybe that doesn't fix the internal index cause it has those indexed already. I've triggered a reindex. Lets see if that works. Probably will take an hour or so.

[lucadelu]

Yes, UNI folder. I checked again and It seems everything as before

[robe]

But you don't see the pictures that were in the UNI folder in the main folder as well? I'm suspecting it's some setting about deduplication. I recall there is no easy way to delete photos once they've been indexed, but I thought it would just duplicate the reference if they were moved into another folder.

[robe]

Not ideal, but I added all the photos in UNI and the FOSS4G2022 to a FOSS4G2022 album

​https://photoprism.osgeo.org/s/1m6937s61b/ari137b31j9l56dd

Does the count of photos look about right?

[robe]

We are using a combination of photoprism and nextcloud for this.