The tournament is on and hopefully if you read this blog you already know that. Just gonna throw some links out in case you haven’t found ‘em yet:
The Live Stream (open manually in Windows Media Player if accessing via browser doesn’t work)
Alliance Tournament Events Home (schedule, results, etc)
This might or might not matter to anyone, but the price median static export files should be generating faster now. A combination of consolidating some scripts and queries as well as adding daily pruning of the raw price table should hopefully cut down the generation time from 2 hours to 1 hour or less for all files. I may need to tweak some of the indexes yet, but hopefully this should reduce some of the stress on my server when I generate these files.
As a general note, the order of the file generation is by RegionID and then the final galaxy-wide file.
So, I’ve hacked in preliminary corp asset support (thanks to the fellow who loaned me the full API key of a corp director). The initial UI simply requires checking the ‘Load Corp Assets’ checkbox when you enter your API key and choose the character that is a corp director. This will load the corp assets instead of the personal assets in the same manner as loading personal assets.
The application simply handles a corp like it handles a player - the assets are stored in the same way and the corporation will have its own charid_hash that is accessible if you know the API key or someone has given you the URL. The only difference in the database is the new field is_corp in the asset_update table.
I have not yet implemented the addition of conquerable stations to the database. Hopefully I’ll be able to get around to this soon.
Medians are roughly implemented in the assets viewer and there are no more direct calls to eve-central. Instead, the code retrieves the static median exports from my price system and loads them into a table. This is not automated or scheduled in any way at this point, it’ll require manually running process_median_xml.php whenever you want fresh medians or scheduling that script to run daily/weekly/whatever. It also allows to retrieve medians for all of the regions or any single region and lets the user choose the region to get prices from - generally The Forge will have the most data and the least chance of really wacky prices since volume is so much greater in Jita and surrounding areas.
You can check this stuff out at the live beta site. The code that powers this should be available in the nightly when it generates at approximately midnight CST (-0600 GMT). There are probably still some rough edges in this code.
It also requires a few changes/additions to the database, so check out import_extra.sql for any new tables that you might not have if you install this newer version.
Medians have been updated today. Cron was indeed not running on nonninja. Tables are repaired and any attempts to do mass deletions from the highly indexed raw price table have been abandoned. I’ve got some code brewing that should let me do that without, y’know, taking down my host.
I’m also planning on doing some assets work this week - primarily getting my median price feeds integrated into the application as well as removing the last vestiges of direct calls to eve-central which have been a thorn in the side of the app, especially for folks installing the code on their own machines.
I’ll just put this here in case anyone is willing - I am looking for full API key access to someone with director roles in a corp with a few assets to test out “official” integration of corp assets into the codebase. It’s a lot to ask so I doubt anyone will be forthcoming, just wanted to throw it out there. Making a corp with an alt is still on my lists of things to do, just haven’t gotten there yet (mainly because I’m lazy and not playing a ton of EVE atm).
Cron might be messed up on my host as it looks like prices didn’t generate today or yesterday. I’ll be checking into it some more tomorrow. I also have a few behind the scenes changes coming up to make generation faster and hopefully more robust as well as using only the last 30 days of data rather than everything since mid-November. Stay tuned.
I’ve been trying to prune old prices from the raw prices table all day and it’s caused some severe performance problems for this entire server. For whatever reason, MySQL is not happy with that table and is taking obscenely long to delete records and/or drop old indexes that are no longer needed. We had to kill the server outright and I’m now doing some table repairs. I believe all the apps should still work, but medians may not get updated tomorrow depending on how bad a state the tables are in.
Any MySQL gurus out there? Is there a reason dropping an index from a table would take forever and a day?
\o/ I have no idea why the medians ran without problem this morning, but they did. Despite this, I’m moving forward on some data pruning to make the dataset smaller and more relevant. Then plan is that the raw price table will have all prices reported more than a month ago removed and possibly include the ability to get medians on a shorter timeline than that (i.e., get the medians for only the last 7 days).
Price median generation is still progressing veeeery slowly. I’m going to kill the job again and put some optimizations into play. Regions 1-31 were updated today, the rest are now 2 days old.
The current nightly build of the PHP Assets Viewer is not very stable. In particular, the character picker is not working correctly. I’ve not yet had a chance to look into and fix this issue - until it’s resolved, you should use the older stable version.