Bella’s Eve Tools

Medians have been updated today.  Cron was indeed not running on nonninja.  Tables are repaired and any attempts to do mass deletions from the highly indexed raw price table have been abandoned.  I’ve got some code brewing that should let me do that without, y’know, taking down my host.

I’m also planning on doing some assets work this week - primarily getting my median price feeds integrated into the application as well as removing the last vestiges of direct calls to eve-central which have been a thorn in the side of the app, especially for folks installing the code on their own machines.

I’ll just put this here in case anyone is willing - I am looking for full API key access to someone with director roles in a corp with a few assets to test out “official” integration of corp assets into the codebase.   It’s a lot to ask so I doubt anyone will be forthcoming, just wanted to throw it out there.  Making a corp with an alt is still on my lists of things to do, just haven’t gotten there yet (mainly because I’m lazy and not playing a ton of EVE atm).

Cron might be messed up on my host as it looks like prices didn’t generate today or yesterday.  I’ll be checking into it some more tomorrow.  I also have a few behind the scenes changes coming up to make generation faster and hopefully more robust as well as using only the last 30 days of data rather than everything since mid-November.  Stay tuned.

I’ve been trying to prune old prices from the raw prices table all day and it’s caused some severe performance problems for this entire server.  For whatever reason, MySQL is not happy with that table and is taking obscenely long to delete records and/or drop old indexes that are no longer needed.  We had to kill the server outright and I’m now doing some table repairs.  I believe all the apps should still work, but medians may not get updated tomorrow depending on how bad a state the tables are in.

Any MySQL gurus out there?  Is there a reason dropping an index from a table would take forever and a day?

\o/  I have no idea why the medians ran without problem this morning, but they did.  Despite this, I’m moving forward on some data pruning to make the dataset smaller and more relevant.  Then plan is that the raw price table will have all prices reported more than a month ago removed and possibly include the ability to get medians on a shorter timeline than that (i.e., get the medians for only the last 7 days).

Price median generation is still progressing veeeery slowly.  I’m going to kill the job again and put some optimizations into play.  Regions 1-31 were updated today, the rest are now 2 days old.

The current nightly build of the PHP Assets Viewer is not very stable.  In particular, the character picker is not working correctly.  I’ve not yet had a chance to look into and fix this issue - until it’s resolved, you should use the older stable version.

Price update was taking too long and bringing the server to its knees so I have killed price updates for today.  Hopefully I can make some changes today that will speed up the process for tomorrow’s run.  It looks like regions 1-30 got updated.  Expect prices to be updated correctly for Thursday.

Medians are updating very slowly today, not entirely sure why.  I plan to change a little of the file generation code to possibly make it faster (it currently runs 2 scripts to create the text and xml file when it could just be running 1).

Kicking this little blog into action, primarily to keep track of my apps and provide updates to anyone who wants it.

I plan on updating this with notes on new releases of my web apps or any changes that may come to pass.