Opened 8 years ago

Closed 7 years ago

#798 closed defect (fixed)

download.osgeo.org is down

Reported by: markrobinson Owned by: warmerdam
Priority: major Milestone:
Component: Systems Admin Keywords: download
Cc: wildintellect, jive

Description

The Maven repository at http://download.osgeo.org/ is down. It has been down for several days and prevents any project which depends on it from building.

Change History (17)

comment:1 Changed 8 years ago by wildintellect

Priority: blockermajor
Type: taskdefect

This is due to the massive power outage in the San Diego, Arizona, Northern Mexico region. We are aware of it (was emailed around the SAC list shortly after happening) and are waiting for the hardware to be turned back on (some networking equipment may have been damaged). Thanks for reporting. For those looking to access existing files please use http://download2.osgeo.org

There is no redundancy for the webdav connection or maven unfortunately.

comment:2 Changed 8 years ago by warmerdam

Owner: changed from sac@… to warmerdam

I'm going to update download.osgeo.org dns to point to the mirror...

comment:3 Changed 8 years ago by warmerdam

Keywords: download added
Status: newassigned

done

I'll leave this ticket open until things are all restored to normal.

comment:4 Changed 8 years ago by jef

Any news on this?

comment:5 Changed 8 years ago by wildintellect

Download is pointing to the backup mirror still. So everything except webdav for maven is working.

We have a plan to bring up another VM to replace the machine that's still down. Will probably take a few days. Ticket will stay open until we finish.

comment:6 in reply to:  5 Changed 8 years ago by jef

Replying to wildintellect:

Download is pointing to the backup mirror still. So everything except webdav for maven is working.

Not including uploads (e.g. to OSGeo4W) - or am I missing something?

We have a plan to bring up another VM to replace the machine that's still down. Will probably take a few days. Ticket will stay open until we finish.

Does that mean it's not a matter of just powering the machine back on anymore?

comment:7 Changed 8 years ago by theduckylittle

Jef,

You are correct - uploads are currently not convenient though they could be done.

While we could likely get the telascience blade powered back on this current situation emphazises the decreasing degree of operational support from Telascience. So it is prudent to just get things somewhere where we have more control.

comment:8 Changed 8 years ago by warmerdam

The above comment for Jurgen was actually from me, not Dan.

comment:9 Changed 8 years ago by warmerdam

Cc: wildintellect added

The download VM is created at download.osgeo.osuosl.org. I will try to set it most of it up tonight, and then Alex will address Backula (for /etc), and some other specialized stuff.

comment:10 Changed 8 years ago by warmerdam

The download VM is configured with proper certificates and is now cloning from the backup. This may take a bit of time...

Once done I'll still need to configure apache, etc.

comment:11 Changed 8 years ago by warmerdam

OK, I have:

  • mirrored from the backup server (in /osgeo/download)
  • installed and configured apache to serve download.osgeo.org and download.osgeo.osuosl.org from there.
  • redirected dns for upload.osgeo.org and download.osgeo.org to the VM.
  • setup vsftpd service on the VM (but ftp.remotesensing.org has not been redirected)
  • setup support for rsync'ing from the VM (though I'm not sure that rsyncd is starting on reboot properly)

Things to do:

  • Ensure rsyncd is starting automatically.
  • Setup rsync backups to outside locations (iweb.gdal.org perhaps, eventually USACE, telascience).
  • Get the OSGeo4W /cgi-bin scripts working.
  • Backula backups of at least /etc.
  • get ftp.remotesensing.org repointed.
  • get webdav stuff working (if it isn't already)

comment:12 in reply to:  11 Changed 8 years ago by jef

Replying to warmerdam:

Things to do:

  • Get the OSGeo4W /cgi-bin scripts working.

The scripts are working again. With Martin's help. He setup the two symlinks in /usr/lib/cgi-bin. For that the scripts were slightly modified to produce the appropriate HTTP headers.

We also packaged and installed libhtml-diff-perl from CPAN (used to produce the versions_diff.html).

FTR that went something like this (although the package was actually created offsite):

apt-get install libalgorithm-diff-perl
dh-make-perl --cpan HTML::Diff --desc "Perl module for finding changes between two strings of HTML"
cd HTML-Diff-*
dpkg-buildpackage -uc -uc -b
dpkg -i ../libhtml-diff-perl*_all.deb

comment:13 Changed 8 years ago by warmerdam

I have started mirroring to iweb.gdal.org.

I have contacted Mark Lucas to repoint ftp.remotesensing.org to the new VM.

comment:14 Changed 8 years ago by warmerdam

It looks like the outstanding issues are:

  • get webdav stuff working (also #811) - action to Alex.
  • Get Backula backups of configuration, /etc working - action to Alex
  • Confirm rsync works after reboot - frank
  • Establish one more mirror beyond iweb.gdal.org (perhaps at telascience) - action Frank

comment:15 Changed 8 years ago by warmerdam

Cc: jive added

comment:16 Changed 8 years ago by jive

wildintellect was able to sort out webdav (no idea how). In any case the geotools build is back on thank you!

He also request that we consider the use of SFTP in the future. A bit of research shows that this is possible.

comment:17 Changed 7 years ago by warmerdam

Resolution: fixed
Status: assignedclosed
Note: See TracTickets for help on using tickets.