Archive for the ‘Price Medians’ Category

Temporarily Taking Down Prices

Thursday, July 24th, 2008

I’ve been having some massive MySQL issues on my machine recently, so prices will not be updated until I have these issues of load resolved.  A few queries or processes are basically taking down the whole machine due to some bad design so I’m going to try to fix these and get it back up and running.

Sorry  :(

Faster Median Generation

Thursday, February 28th, 2008

This might or might not matter to anyone, but the price median static export files should be generating faster now.  A combination of consolidating some scripts and queries as well as adding daily pruning of the raw price table should hopefully cut down the generation time from 2 hours to 1 hour or less for all files.  I may need to tweak some of the indexes yet, but hopefully this should reduce some of the stress on my server when I generate these files.

As a general note, the order of the file generation is by RegionID and then the final galaxy-wide file.

Medians Running Again

Monday, February 25th, 2008

Medians have been updated today.  Cron was indeed not running on nonninja.  Tables are repaired and any attempts to do mass deletions from the highly indexed raw price table have been abandoned.  I’ve got some code brewing that should let me do that without, y’know, taking down my host.

I’m also planning on doing some assets work this week - primarily getting my median price feeds integrated into the application as well as removing the last vestiges of direct calls to eve-central which have been a thorn in the side of the app, especially for folks installing the code on their own machines.

I’ll just put this here in case anyone is willing - I am looking for full API key access to someone with director roles in a corp with a few assets to test out “official” integration of corp assets into the codebase.   It’s a lot to ask so I doubt anyone will be forthcoming, just wanted to throw it out there.  Making a corp with an alt is still on my lists of things to do, just haven’t gotten there yet (mainly because I’m lazy and not playing a ton of EVE atm).

Cron Issues, Maybe

Sunday, February 24th, 2008

Cron might be messed up on my host as it looks like prices didn’t generate today or yesterday.  I’ll be checking into it some more tomorrow.  I also have a few behind the scenes changes coming up to make generation faster and hopefully more robust as well as using only the last 30 days of data rather than everything since mid-November.  Stay tuned.

It Worked!

Friday, February 22nd, 2008

\o/  I have no idea why the medians ran without problem this morning, but they did.  Despite this, I’m moving forward on some data pruning to make the dataset smaller and more relevant.  Then plan is that the raw price table will have all prices reported more than a month ago removed and possibly include the ability to get medians on a shorter timeline than that (i.e., get the medians for only the last 7 days).

More Price Median Woes

Thursday, February 21st, 2008

Price median generation is still progressing veeeery slowly.  I’m going to kill the job again and put some optimizations into play.  Regions 1-31 were updated today, the rest are now 2 days old.

Killed Price Update

Wednesday, February 20th, 2008

Price update was taking too long and bringing the server to its knees so I have killed price updates for today.  Hopefully I can make some changes today that will speed up the process for tomorrow’s run.  It looks like regions 1-30 got updated.  Expect prices to be updated correctly for Thursday.

Slow Median Update

Wednesday, February 20th, 2008

Medians are updating very slowly today, not entirely sure why.  I plan to change a little of the file generation code to possibly make it faster (it currently runs 2 scripts to create the text and xml file when it could just be running 1).