Changes between Version 5 and Version 6 of PscMeeting05-07-2009


Ignore:
Timestamp:
May 7, 2009, 12:33:31 PM (15 years ago)
Author:
brucedechant
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PscMeeting05-07-2009

    v5 v6  
    2020 * Approaches to improve error propagation from FDO
    2121 * Finding a time for one of the upcoming PSCs where the Australians can participate?
     22
     23
     24== Minutes ==
     25
     26PSC Members present: Tom, Bob, Bruce, Andy, Haris.
     27
     28=== Review last meeting's action items ===
     29 * All items are on todays meeting as well
     30
     31=== Available MGOS developers ===
     32 * ??
     33
     34=== Voting on RFC60 ===
     35 * Bruce will bring it to a vote.
     36
     37=== Commit rights for UV ===
     38 * Not at this time as the process for being granted commit rights needs to be followed and is not complete.
     39
     40=== Handling of failed tiles ===
     41 * UV volunteered to write an RFC for a solution to this - Tom will ask him.
     42
     43=== Approaches to improve error propagation from FDO  ===
     44 * Fix MACROs that are creating new exceptions that lose parent FDO error
     45
     46=== Finding a time for one of the upcoming PSCs where the Australians can participate ===
     47 * Bob will ask on list for a more friendly time
     48
     49=== Performance and Stability ===
     50 * Discussed selection issue
     51 * Haris will investigate further
     52
     53=== End of meeting ===
     54
     55== Full transcript ==
     56{{{
     57
     58Known Networks          ChatZilla error         Connected Networks      <none>
     59URL     irc://foo/bar   Not Connected   Lag     <unknown>
     60URL     irc://irc.freenode.net/mapguide         Mode    +tnc    Users   9, 1@, 0%, 0+
     61Topic   MapGuide Open Source | Home: http://mapguide.osgeo.org/ | Bugs: http://trac.osgeo.org/mapguide | See Also: #OSGeo #FDO | Stats: http://www.ohloh.net/projects/4656 -and- http://cia.navi.cx/stats/project/MapGuide
     62URL     irc://foo/bar   Connected via   <none>
     63<none>
     64<none>
     65<none>  Connected to    <none>
     66File            Progress        <unknown>
     67 
     68#mapguide
     69        [INFO]  Channel view for “#mapguide” opened.
     70        *NickServ*      Please identify via /msg NickServ identify <password>.
     71        =-=     User mode for bdechant is now +i
     72        -->|    YOU (bdechant) have joined #mapguide
     73        =-=     Topic for #mapguide is “MapGuide Open Source | Home: http://mapguide.osgeo.org/ | Bugs: http://trac.osgeo.org/mapguide | See Also: #OSGeo #FDO | Stats: http://www.ohloh.net/projects/4656 -and- http://cia.navi.cx/stats/project/MapGuide”
     74        =-=     Topic for #mapguide was set by jasonbirch on Monday, May 28, 2007 12:47:53 PM
     75        ===     #MapGuide http://mapguide.osgeo.org/
     76        <bdechant>      Hello everyone
     77        [INFO]  This channel requires that you have registered and identified yourself with the network's nickname registration services (e.g. NickServ). Please see the documentation of this network's nickname registration services that should be found in the MOTD (/motd to display it).
     78        <rbray> Hey Bruce, Hi Harris
     79        <HarisK>        hi
     80        <tomf2> Hi, this is Tom
     81        <rbray> I am going to give folks another minute
     82        <rbray> Alright, well let's start and see if anyone else joins
     83        <rbray> Who want's to take minutes today?
     84        <rbray> Was that Bruce I heard volunteer?
     85        <bdechant>      :)
     86        <bdechant>      Sounds fine Bob
     87        <rbray> First item is: Available MGOS developers
     88        <rbray> I believe that is Tom's
     89        <tomf2> I know of some excellent developers who have done work on MGOS
     90        <tomf2> I think that there may be some projects for them, but I'm not sure what or who has them
     91        <rbray> So to clarify Tom, these are freelance developers looking for work?
     92        <tomf2> I'm wondering if we should set up a page or something that allows these people to contact each other
     93        <tomf2> Yes, freelance, that is, they are not Autodesk developers
     94        <HarisK>        I know 3 of them , counting me :)
     95        <rbray> Hmm, I would suggest the wiki
     96        <rbray> But don't you need commit rights to edit?
     97        <tomf2> Anyone can edit the wiki
     98        <tomf2> you just need a trac login
     99        <tomf2> I think
     100        <HarisK>        wiki page would be to make list of available MGOS developers, to present themselves ?
     101        <tomf2> Yes, that was what I was thinking
     102        <tomf2> If we're OK with that, I could look around at some other projects and see if they are doing anything similar, and perhaps use that as a model.
     103        <HarisK>        sounds fine
     104        <rbray> Makes sense to me
     105        <tomf2> Great
     106        <rbray> They could also introduce themselves on the internals mail list
     107        <tomf2> good idea
     108        <rbray> Anyone disagree with having a wiki page for freelance developers?
     109        <rbray> ok then, Tom you have the action to create a wiki page for that
     110        <tomf2> Ok
     111        <rbray> Next item: voting on RFC60
     112        <tomf2> I think the next items are either Zac's or UV's
     113        <rbray> Well for RFC60, if we think it is ready to vote - then a PSC member just needs to put it for a vote on the mail list
     114        <rbray> UV can't bring it forward for a vote because he is not a PSC member
     115        <tomf2> Has it been put out for review? I can't recall
     116        <rbray> yes it has had lots of feedback
     117        <tomf2> bdechant, could you put it out for vote if no one else volunteers?
     118        <bdechant>      sure :)
     119        <HarisK>        I cant remmber discussion arround, rfc allone
     120        <HarisK>        more about some problems beign found
     121        <bdechant>      that is the latest I recall too
     122        <rbray> well according to UV's last e-mail the patch is ready for review and to submit
     123        <bdechant>      May I suggest that you look it over today and if no one comments I can post for a vote tomorrow
     124        <tomf2> We can also look over it during the vote and reject if we see problems
     125        <tomf2> That's only 48hours though as opposed to 7 days
     126        <rbray> either is fine, I looked at it today and it seems like he has already addressed a number of issues that folks raised
     127        <tomf2> So my vote is to go directly to vote.
     128        <rbray> Mine too
     129        <bdechant>      ok I'll call for a vote today
     130        <rbray> ok
     131        <rbray> thanks
     132        <rbray> The next item is this one: commit rights for UV to support configuration management
     133        <tomf2> +1
     134        <rbray> really?
     135        <rbray> I have two concerns:
     136        <rbray> What code has he submitted so far and who has reviewed it - I'd like their input
     137        <rbray> Some of his comments on the list have been inflamitory
     138        <rbray> Any reactions?
     139        <bdechant>      I agree
     140        <rbray> To the later I presume
     141        <rbray> Anyone know the answer to the first
     142        <rbray> GEnerally I'd like to see at least a couple of submissions
     143        <bdechant>      I have not reviewed his code submission so cannot comment on that
     144        <tomf2> I thought that configuration management is not part of the main code stream, like the installer stuff is, but actually it is all the project files and build files, and these are pretty central. My mistake. This is a pretty importanta area
     145        <HarisK>        Bob , that is good point, to get some working results
     146        <tomf2> Patch files should be the appropriate process for this
     147        <rbray> Yes I would like to see a few patches
     148        <tomf2> I mean, use our normal process of submitting patches first, then getting commit rights
     149        <bdechant>      I would like to see a few patches 1st before commit rights
     150        <rbray> Well that is the way the process of adding developers is documented - proven track record, recommendation, vote
     151        <rbray> So let's put that one off for now
     152        <bdechant>      Yup and that is what I would for us to use :)
     153        <bdechant>      *like
     154        <rbray> Ok next item: Handling of failed tiles http://n2.nabble.com/Server-rendering-incomplete-tiles---Defect-or-Feature---td2785311.html
     155        <rbray> What's the background on this?
     156        <bdechant>      Essentially the stylizer eats any exception it encounters
     157        <bdechant>      No feedback ir given to the user, an error is logged and that is it
     158        <tomf2> Looks like someone would need to put an RFC together on how to resolve this, then we could go from there
     159        <bdechant>      Agree as this is more then a simple defect fix
     160        <rbray> Yes I guess we need a proposal for alternate behavior
     161        <rbray> and some discussion around what the "right" behavior is
     162        <tomf2> Yes, looking at that discussion, there are different possible solutions for different scenarios
     163        <tomf2> Towards the end UV asks if he should put an RFC together for this. So I'll reply and say yes.
     164        <rbray> Ok - sounds like a plan.
     165        <HarisK>        I believe I dont agree with posiblle resolution from email
     166        <HarisK>        but +1 for writting rfc
     167        <rbray> yes let's see if UV will submit an RFC - then we will have something to discuss
     168        <rbray> ok
     169        <rbray> How about this one: Approaches to improve error propagation from FDO
     170        <rbray> Anyone know what this is about?
     171        <tomf2> no
     172        <HarisK>        I sen email day or two ago on internal list, about FDO error not going into MG log
     173        <HarisK>        unhandled exception goes in
     174        <bdechant>      From what I understand this has to do with propogating up the underlying error along with the FDO error
     175        <HarisK>        if that is the topic, then it is more a smaller defect/bug from what i saw
     176        <bdechant>      So being able to see the parent error along with the FDO wrapper error
     177        <HarisK>        it goes as unhadled instead of fdo error
     178        <HarisK>        some bug in macros being used i believe
     179        <bdechant>      several currently do yes
     180        <HarisK>        it is small issue in code I think, but could help a lot sometimes to see correct message in log file
     181        <bdechant>      I think this is more of an FDO issue as MG already catches and logs them
     182        <HarisK>        hm I think not
     183        <bdechant>      Explain?
     184        <HarisK>        ther is one macro which caches FDO exception and then throws unknown MG exception
     185        <HarisK>        I posted that in email ,just a sec
     186        <bdechant>      Actually there are severla macors that are used, some of hte Unclassified ones are a result of FDO not throwing an exception at all
     187        <HarisK>        #define RSFR_CATCH() } \
     188        <HarisK>        catch (MgException* ex) \
     189        <HarisK>        { \
     190        <HarisK>        ex->Release(); \
     191        <HarisK>        throw FdoException::Create();\
     192        <HarisK>        }
     193        <HarisK>        after this originall FDO messages gets lost
     194        <bdechant>      That one is bad and needs to be fixed
     195        <HarisK>        :)
     196        <HarisK>        and couple more
     197        <bdechant>      I think we are talking about 2 issues here then
     198        <HarisK>        but yes, it is not big task
     199        <bdechant>      1) Macros need to be fixed
     200        <rbray> Seems like we should just fix this
     201        <bdechant>      2) Internal error codes from underlying RDBMs are not being propogated up via FDO
     202        <bdechant>      If we are talking about #1 then ignore my other comments as I was assuming #2
     203        <rbray> we should fix #1
     204        <rbray> and raise the second to the FDO PSC
     205        <bdechant>      For MapGuide - I agree #1 needs to be fixed
     206        <HarisK>        I was not aware about 2
     207        <HarisK>        agree,s to FDO list
     208        <rbray> Ok everyone I need to wrap up as I have another meeting
     209        <bdechant>      I beleive #2 will be raised at the next FDO PSC (From those I have talked to(
     210        <tomf2> Those internal error codes are data source specific, so how useful would they be.
     211        <rbray> I will ask on the list about a more friendly Aussie time for this meeting.
     212        <HarisK>        ok
     213        <tomf2> I'm OK with other times as long as it is not between 10pm and 7am mountain time
     214        <rbray> wimp
     215        <tomf2> OK, 10:30pm and 7am
     216        <bdechant>      :)
     217        <HarisK>        next topic: perfomance and stability ?
     218        <HarisK>        :)
     219        <rbray> You guys can keep talking - I think that is a good topic
     220        <rbray> But I have to run
     221        <tomf2> I'm interested in that, can you stick around Harris?
     222        <HarisK>        we are having hard time on couple of projects
     223        <HarisK>        yes great
     224        <tomf2> What are you finding?
     225        <rbray> ok guys - thanks
     226        <tomf2> OK, thanks Bob, bye
     227        <HarisK>        thanks Bob
     228        <HarisK>        we have problems with both speed and performnace
     229        <HarisK>        we tried to use Fusion also
     230        <HarisK>        it was not good from current release
     231        <tomf2> What providers are you using?
     232        <bdechant>      Can you describe the user scenario?
     233        <HarisK>        after applying all trunk stuff
     234        <tomf2> current release = MGOS 2.1?
     235        <HarisK>        it is almost usable but stil... not satisfactory
     236        <HarisK>        yes
     237        <HarisK>        2.1
     238        <HarisK>        in general, it is quite a few issues
     239        <HarisK>        speed is still slow
     240        <HarisK>        we dont use tiles
     241        <HarisK>        also stability, we have problems with multiple users
     242        <HarisK>        still trying to understand where problem is
     243        <bdechant>      For slow - are you referring to rendering map, selection, something else?
     244        <HarisK>        I am also loooking at King.Oracle and MapGuide
     245        <HarisK>        it seems something with selection
     246        <bdechant>      About how many items are being selected?
     247        <HarisK>        selection was very bad with some of current releases of Fusion
     248        <HarisK>        it got improved a bit
     249        <HarisK>        It is hard to talk light this, we would need to get some numbers
     250        <HarisK>        I mean, hard to tell where really time is lost
     251        <HarisK>        overall experience is not good
     252        <HarisK>        not much, 10-15 items
     253        <bdechant>      There is an issue when selecting thousands of features
     254        <HarisK>        map is about 50 layers
     255        <tomf2> Selection is much more responsive in Fusion, we draw the selection first, then asynchronously populate the properties panel. So it should seem more responsive because the user sees the selection quickly. Also, there was a lot of work to improve the performance of getting the property values back from the server.
     256        <HarisK>        what is issue with selection ?
     257        <bdechant>      Very slow with lots of features
     258        <HarisK>        I have started to think that function Renderforselection could have some multithreading issues too
     259        <bdechant>      I haven't seen this with small #s
     260        <HarisK>        we are getting MG crashed with several select requests, don't know why yet
     261        <bdechant>      ouch - what providers involved?
     262        <HarisK>        yes speed of selection is much better now
     263        <HarisK>        but only if you compare it to previous release which was almost unusable
     264        <HarisK>        King.Oracle
     265        <HarisK>        I am still looking most intop provider itself for reason
     266        <bdechant>      Would it be possible for you to send me a package that I could play with?
     267        <tomf2> A selection with a 50 layer map should display on the screen within a second (well, that's what we see in MG Enterprise)
     268        <HarisK>        but can't find anything yet (we spend a almost week on it)
     269        <bdechant>      Have you tried replicating the crash with SDF/SHP/MySQL?
     270        <HarisK>        unfortunately not
     271        <HarisK>        we have this layers on customer site
     272        <tomf2> How many seconds are you seeing?
     273        <HarisK>        with some Orcqel links and ESB bus etc..
     274        <HarisK>        Oracle
     275        <HarisK>        no crash with SDF with some of data
     276        <bdechant>      What about trying the Autodesk ORacle provider?
     277        <HarisK>        hm, cant tell seconds exactly
     278        <HarisK>        yes, we could try that too ( if he can suport views now)
     279        <tomf2> yes, Autodesk Oracle provider supports views
     280        <HarisK>        overall experience is not good for our customers ( and we are not either)
     281        <tomf2> It might be the new DescribeSchema work that speeds things up. Testing using the Autodesk Oracle provider could help us see
     282        <HarisK>        it is not provider itself or schema for speed
     283        <HarisK>        schema is cached and data is retrieved quickly enough, that i could meassure
     284        <tomf2> The new describeSchema support really shrinks the size of the schema that the server needs to maintain
     285        <HarisK>        one of things, I see now I believe even more requests generated to MG from Fusion
     286        <tomf2> Getting the schema might be fast, but if it is a large object, the server might have trouble maintaining it
     287        <HarisK>        schema is cached in provider so it is just initall load which takes a bit longer
     288        <tomf2> The new fusion should have 50% less requests than the 2.0 version
     289        <HarisK>        Fusion 2.0 yes
     290        <HarisK>        I mean, I assume that yes
     291        <HarisK>        but still
     292        <tomf2> Right, but the server needs to pass the schema around; for example to the web tier. Smaller is better
     293        <HarisK>        compared to ajax viewer or ...
     294        <HarisK>        we have same speed feeling with sdf
     295        <HarisK>        it even feels slower in multiple users environment
     296        <tomf2> How many classes in the SDF schema
     297        <HarisK>        4-5
     298        <HarisK>        the one we used for selection test
     299        <tomf2> Oh, that's not many at all
     300        <HarisK>        no, it is not
     301        <HarisK>        I don't think there is quick solution
     302        <bdechant>      Seems like very little schema information
     303        <HarisK>        but I do think that really but really :)
     304        <HarisK>        performance and stability should be priority
     305        <tomf2> Bruce, you asked for a package earlier, how about testing with the SDF?
     306        <tomf2> yes, performance and stability are always a priority
     307        <bdechant>      Either would be fine - I just want to see what is happening in the debugger for selection in this case
     308        <HarisK>        I know we always talk about hose two
     309        <HarisK>        but somehow, it seems slower and less stable then 1.2
     310        <HarisK>        I know, we could just be a bit frustrated right now
     311        <bdechant>      that seems odd and we need to get to the bottom of it
     312        <HarisK>        one of things I would like to know
     313        <HarisK>        where time is really lost
     314        <tomf2> The way we work is to fix things that we know about. It probably just means we haven't run into what you are seeing right now.
     315        <HarisK>        to have some type of test tool, to try to seperate rendering part, web part, etc..
     316        <HarisK>        you are satisfied with the speed ?
     317        <bdechant>      For some things yes - for others no
     318        <HarisK>        :)
     319        <tomf2> For a sub second select, yes. But if you are seeing selection taking 20 seconds no; but like I said, we don't see that
     320        <bdechant>      There is always room for improvement :)
     321        <HarisK>        you are in politic too ? :)
     322        <HarisK>        I just feel that something radical/serious should be done to get it much better
     323        <tomf2> You think there is a fundamental flaw in the architecture that will prevent something from being responsive?
     324        <HarisK>        I was even thingik to get stylization "out" to see how fast just rendering wotks
     325        <tomf2> rendering is fast, I don't think that you will find anything there
     326        <HarisK>        fundamental flaw ? hm no
     327        <HarisK>        perhaps services over tcp/ip
     328        <tomf2> It seems that most of the problems are in the support of rendering
     329        <bdechant>      I think some timing hooks could be added so that when doing some of the advanced trace logging you could see some of the server's internal #s
     330        <HarisK>        what about getting rendering and feature access directly into web part ?
     331        <bdechant>      that would be one of the more radical suggestions :)
     332        <HarisK>        :)
     333        <HarisK>        I looked a worked a lot with MG code lately, I do have feeling that some parts are
     334        <bdechant>      I don't think that is the bottleneck though
     335        <HarisK>        very how to say "nice", nice classes calls etc..
     336        <HarisK>        but sometimes it looks , I don't know how to express, "overdone" in nice
     337        <HarisK>        I dont know if you can understand me
     338        <bdechant>      Ohh I know what you mean - there is some code that could be much more efficent while still being clean and well presented
     339        <HarisK>        yes
     340        <tomf2> Sometimes dirty code is required for optimizations, but we need to find out where those parts are first
     341        <tomf2> Do you have access to code profilers such as GlowCode or Visual Studio Team Editon or Intel VTune etc.?
     342        <HarisK>        hm no, I grew in area of no debuggers :)
     343        <tomf2> The team here uses them and they are very useful; and of course you can't just use one because they all give different answers.
     344        <bdechant>      They can also generates lots of noise that needs t obe filtered out :)
     345        <tomf2> I have to go now. It looks like there is a specific problem that Bruce is interested in seeing; selection using a particular DS. If you could get him that package, that would be great!
     346        <tomf2> DS = data source
     347        <HarisK>        thank you, I will try
     348        <HarisK>        I will try to spare bruce time too
     349        <HarisK>        if we dont find reaso by monday next week, i will contact you again
     350        <bdechant>      Sounds good
     351        <bdechant>      So meeting over then - thanks all
     352        <HarisK>        thank you for listening me
     353}}}