Opened 11 years ago

Closed 11 years ago

#1096 closed enhancement (fixed)

add ipython and ipython-notebook packages to the build

Reported by: darkblueb Owned by: live-demo@…
Priority: normal Milestone: OSGeoLive7.0
Component: OSGeoLive Keywords: ipython
Cc: epifanio

Description

the "mad genius" epifanio does fun things with ipython-notebook.. it makes a graphical environment and he uses it to plot science data and drive OSSIM. It is about 26M install and when it runs it takes port 8888. The spreadsheet says that nothing else uses 8888.

Hamish is concerned about using common ports numbers, but we allow 8000 and 8080 already!

Change history (11)

comment:1 by kalxas, 11 years ago

Milestone: OSGeoLive6.5OSGeoLive7.0

it is late to add this to 6.5. moving this to 7.0

comment:2 by hamish, 11 years ago

Cc: epifanio added

In a generic sense you should be able to configure any particular program to use a particular port; it shouldn't be an issue to change that at will. The problem with using common-looking port numbers is that everyone gets the same idea from the same set of 10-15 and with 40 projects we get conflicts (again). The solution is for everyone to avoid them- then if one falls through the cracks unnoticed we are much less likely to have a conflict.

The system-wide tomcat6 is a special case, it can use 8080. :)

Anything else has not been explicitly "allowed", it just hasn't gotten its nasty-gram asking to use something else yet.

(mapnik's tilelite looks like it's running on port 8012, not 8000 by the way)

for OSSIM the best alternative I could think up was the numberfied version of the name ("M" doesn't translate very well though), 05514 -> 5514. /etc/services shows nothing standard using that.

Is there a nice & concise highly-geo example for ipython? Or would it be similar to the R and (now shelved) Octave framework quickstarts which could perhaps use a GWR or similar geo-task added?

Hamish

comment:3 by epifanio, 11 years ago

A simple "geo example" of what can be done is available here [1] it can run on any port .. with a simple entry in the command line "--port=xxxx"

For a well done quickstart to include the notebook in the osgeolive doc, i agree we can wait the 7.0

... but at least having it installed by apt-get in the 6.5 will be really good (is 26mb and it's a standard ubuntu pkg, all the sw on the live that use python will have beneft from this installation)

[1] http://nbviewer.ipython.org/url/epi.whoi.edu/esr/GIS_GRASS-R_Example.ipynb

comment:4 by hamish, 11 years ago

Hi,

for the archives, there were a couple of issues which needed to be dealt with to install ipython's custom profile correctly.

  • the ipython create profile command did not like being run with "sudo -u user", something inside it knew it was a lie and it didn't work. So we had to run it as root then migrate the files to /etc/skel/ and /home/user/ by hand.
  • in the chroot root's home dir was /roots/ not /root/
  • if ~/.config/ did not exist, it installed to ~/.ipython. If ~/.config/ did exist it installed to ~/.config/ipython/

Even if super useful, I would had preferred it if new optional software was not added after the feature freeze and instead kept for next time, especially because our disc space is so tight (50mb may make a really big difference at this point as to if we can have persistent 4GB usb sticks or not). It could be a choice between ipython and samba on the disc now, and I don't know the answer to that situation.

cheers, Hamish

comment:5 by epifanio, 11 years ago

few consideration :

Testing the live with the "basic" hardware requirements (1Gb ram, 1 CPU) on a VM

  • working with the Cape Code landsat data is taking too long to process this data (the dataset uncompressed is 60mb per band, 3 bands, plus an srtm)

to fix the space poblems i suggest we remove this dataset form the live and use the "now fixed" north carolina landsat instead.

comment:6 by hamish, 11 years ago

it's too late for changes now, so they'll stay, except if we have a space emergency.

I'm working on fixing those NC geotiffs upstream, which hopefully removes the reason to keep the cape cod ones on the disc, except for them being quite nice of course. :)

Hamish

ps- maybe some new LANDSAT8 data next time! (still trying to track down the wavelength of the new thermal band..)

comment:7 by hamish, 11 years ago

Hi,

the install_ossim script failed on what was hopefully to be the last of our test builds due to the last minute addition of:

  pip install oct2py

this was the error and the script exited before it could install the main ossim files:

  ./install_ossim.sh: 48: ./install_ossim.sh: pip: not found
  ERROR: Package install failed! Aborting.

note we used to have octave on the disc but had to disable it because there wasn't enough space, so oct2py wouldn't be much use anyway.

I've commented out the offending line in r9986.

:-) Hamish

comment:8 by darkblueb, 11 years ago

there is an official backport of ipython from raring - installing it looks like this:

user@live-70a401:~$ sudo apt-get install ipython-notebook  -t precise-backports
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following extra packages will be installed:
  ipython ipython-notebook-common libjs-mathjax libpgm-5.1-0 libzmq1 python-decorator python-simplegeneric python-tornado
  python-zmq
Suggested packages:
  ipython-doc ipython-qtconsole
Recommended packages:
  python-mysqldb
The following NEW packages will be installed:
  ipython ipython-notebook ipython-notebook-common libjs-mathjax libpgm-5.1-0 libzmq1 python-decorator python-simplegeneric
  python-tornado python-zmq
0 upgraded, 10 newly installed, 0 to remove and 3 not upgraded.
Need to get 8,879 kB of archives.
After this operation, 24.9 MB of additional disk space will be used.
Do you want to continue [Y/n]? 
Get:1 http://us.archive.ubuntu.com/ubuntu/ precise/main python-decorator all 3.3.2-1 [21.2 kB]
Get:2 http://us.archive.ubuntu.com/ubuntu/ precise-backports/universe python-simplegeneric all 0.8.1-1~ubuntu12.04.1 [11.8 kB]
Get:3 http://us.archive.ubuntu.com/ubuntu/ precise-backports/universe ipython all 0.13.2-1~ubuntu12.04.1 [664 kB]
Get:4 http://us.archive.ubuntu.com/ubuntu/ precise/universe libjs-mathjax all 1.1-1 [7,071 kB]                               
Get:5 http://us.archive.ubuntu.com/ubuntu/ precise-backports/universe ipython-notebook-common all 0.13.2-1~ubuntu12.04.1 [360 kB]
Get:6 http://us.archive.ubuntu.com/ubuntu/ precise-updates/universe python-tornado all 2.1.0-2ubuntu0.1 [229 kB]             
Get:7 http://us.archive.ubuntu.com/ubuntu/ precise/universe libpgm-5.1-0 i386 5.1.116~dfsg-2 [183 kB]                        
Get:8 http://us.archive.ubuntu.com/ubuntu/ precise/universe libzmq1 i386 2.1.11-1ubuntu1 [107 kB]                            
Get:9 http://us.archive.ubuntu.com/ubuntu/ precise/universe python-zmq i386 2.1.11-1 [206 kB]                                
Get:10 http://us.archive.ubuntu.com/ubuntu/ precise-backports/universe ipython-notebook all 0.13.2-1~ubuntu12.04.1 [25.4 kB] 
Fetched 8,879 kB in 50s (174 kB/s)                                                                                           
Selecting previously unselected package python-decorator.
(Reading database ... 230131 files and directories currently installed.)
Unpacking python-decorator (from .../python-decorator_3.3.2-1_all.deb) ...
Selecting previously unselected package python-simplegeneric.
Unpacking python-simplegeneric (from .../python-simplegeneric_0.8.1-1~ubuntu12.04.1_all.deb) ...
Selecting previously unselected package ipython.
Unpacking ipython (from .../ipython_0.13.2-1~ubuntu12.04.1_all.deb) ...
Selecting previously unselected package libjs-mathjax.
Unpacking libjs-mathjax (from .../libjs-mathjax_1.1-1_all.deb) ...
Selecting previously unselected package ipython-notebook-common.
Unpacking ipython-notebook-common (from .../ipython-notebook-common_0.13.2-1~ubuntu12.04.1_all.deb) ...
Selecting previously unselected package python-tornado.
Unpacking python-tornado (from .../python-tornado_2.1.0-2ubuntu0.1_all.deb) ...
Selecting previously unselected package libpgm-5.1-0.
Unpacking libpgm-5.1-0 (from .../libpgm-5.1-0_5.1.116~dfsg-2_i386.deb) ...
Selecting previously unselected package libzmq1.
Unpacking libzmq1 (from .../libzmq1_2.1.11-1ubuntu1_i386.deb) ...
Selecting previously unselected package python-zmq.
Unpacking python-zmq (from .../python-zmq_2.1.11-1_i386.deb) ...
Selecting previously unselected package ipython-notebook.
Unpacking ipython-notebook (from .../ipython-notebook_0.13.2-1~ubuntu12.04.1_all.deb) ...
Processing triggers for man-db ...
Processing triggers for hicolor-icon-theme ...
Processing triggers for desktop-file-utils ...
Processing triggers for doc-base ...
Processing 62 changed doc-base files, 1 added doc-base file...
Registering documents with scrollkeeper...
Setting up python-decorator (3.3.2-1) ...
Setting up python-simplegeneric (0.8.1-1~ubuntu12.04.1) ...
Setting up ipython (0.13.2-1~ubuntu12.04.1) ...
Setting up libjs-mathjax (1.1-1) ...
Setting up ipython-notebook-common (0.13.2-1~ubuntu12.04.1) ...
Setting up python-tornado (2.1.0-2ubuntu0.1) ...
Setting up libpgm-5.1-0 (5.1.116~dfsg-2) ...
Setting up libzmq1 (2.1.11-1ubuntu1) ...
Setting up python-zmq (2.1.11-1) ...
Setting up ipython-notebook (0.13.2-1~ubuntu12.04.1) ...
Processing triggers for libc-bin ...
ldconfig deferred processing now taking place
user@live-70a401:~$ ipython
Python 2.7.3 (default, Apr 10 2013, 05:46:21) 
Type "copyright", "credits" or "license" for more information.

IPython 0.13.2 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object', use 'object??' for extra details.

comment:9 by kalxas, 11 years ago

Cool, this was included in 7.0beta1. Should we close the ticket now?

comment:10 by hamish, 11 years ago

before closing ticket please check in the build logs that install_ossim's apt-get install ipython-notebook doesn't conflict/reinstall anything.

comment:11 by kalxas, 11 years ago

Resolution: fixed
Status: newclosed

I am closing this ticket since the installation script is now committed and there is a ticket for installation problem #1183

Note: See TracTickets for help on using tickets.