download.osgeo.org is down

[markrobinson]

The Maven repository at ​http://download.osgeo.org/ is down. It has been down for several days and prevents any project which depends on it from building.

[wildintellect]

This is due to the massive power outage in the San Diego, Arizona, Northern Mexico region. We are aware of it (was emailed around the SAC list shortly after happening) and are waiting for the hardware to be turned back on (some networking equipment may have been damaged). Thanks for reporting. For those looking to access existing files please use ​http://download2.osgeo.org

There is no redundancy for the webdav connection or maven unfortunately.

[warmerdam]

I'm going to update download.osgeo.org dns to point to the mirror...

[warmerdam]

done

I'll leave this ticket open until things are all restored to normal.

[jef]

Any news on this?

[wildintellect]

Download is pointing to the backup mirror still. So everything except webdav for maven is working.

We have a plan to bring up another VM to replace the machine that's still down. Will probably take a few days. Ticket will stay open until we finish.

[jef]

Replying to wildintellect:

Download is pointing to the backup mirror still. So everything except webdav for maven is working.

Not including uploads (e.g. to OSGeo4W) - or am I missing something?

We have a plan to bring up another VM to replace the machine that's still down. Will probably take a few days. Ticket will stay open until we finish.

Does that mean it's not a matter of just powering the machine back on anymore?

[theduckylittle]

Jef,

You are correct - uploads are currently not convenient though they could be done.

While we could likely get the telascience blade powered back on this current situation emphazises the decreasing degree of operational support from Telascience. So it is prudent to just get things somewhere where we have more control.

[warmerdam]

The above comment for Jurgen was actually from me, not Dan.

[warmerdam]

The download VM is created at download.osgeo.osuosl.org. I will try to set it most of it up tonight, and then Alex will address Backula (for /etc), and some other specialized stuff.

[warmerdam]

The download VM is configured with proper certificates and is now cloning from the backup. This may take a bit of time...

Once done I'll still need to configure apache, etc.

[warmerdam]

OK, I have:

• mirrored from the backup server (in /osgeo/download)
• installed and configured apache to serve download.osgeo.org and download.osgeo.osuosl.org from there.
• redirected dns for upload.osgeo.org and download.osgeo.org to the VM.
• setup vsftpd service on the VM (but ftp.remotesensing.org has not been redirected)
• setup support for rsync'ing from the VM (though I'm not sure that rsyncd is starting on reboot properly)

Things to do:

• Ensure rsyncd is starting automatically.
• Setup rsync backups to outside locations (iweb.gdal.org perhaps, eventually USACE, telascience).
• Get the OSGeo4W /cgi-bin scripts working.
• Backula backups of at least /etc.
• get ftp.remotesensing.org repointed.
• get webdav stuff working (if it isn't already)

[jef]

Replying to warmerdam:

Things to do:

• Get the OSGeo4W /cgi-bin scripts working.

The scripts are working again. With Martin's help. He setup the two symlinks in /usr/lib/cgi-bin. For that the scripts were slightly modified to produce the appropriate HTTP headers.

We also packaged and installed libhtml-diff-perl from CPAN (used to produce the versions_diff.html).

FTR that went something like this (although the package was actually created offsite):

apt-get install libalgorithm-diff-perl
dh-make-perl --cpan HTML::Diff --desc "Perl module for finding changes between two strings of HTML"
cd HTML-Diff-*
dpkg-buildpackage -uc -uc -b
dpkg -i ../libhtml-diff-perl*_all.deb

[warmerdam]

I have started mirroring to iweb.gdal.org.

I have contacted Mark Lucas to repoint ftp.remotesensing.org to the new VM.

[warmerdam]

It looks like the outstanding issues are:

• get webdav stuff working (also #811) - action to Alex.
• Get Backula backups of configuration, /etc working - action to Alex
• Confirm rsync works after reboot - frank
• Establish one more mirror beyond iweb.gdal.org (perhaps at telascience) - action Frank

[jive]

wildintellect was able to sort out webdav (no idea how). In any case the geotools build is back on thank you!

He also request that we consider the use of SFTP in the future. A bit of research shows that this is possible.