Comments for New software licensing is needed at http://www.xlmpp.com , comment 1 to 2 out of 2 comments http://www.xlmpp.com Thu, 11 Mar 2010 13:14:36 +0100 FeedCreator 1.7.3 http://www.xlmpp.com/blog/Cost-.html#comment-8 Jeff, It was good seeing you in Chicago! As for the CPU seconds portion of your question: In fact we calculate fractions of CPU seconds. For our large clusters (>2000 virtual instances) we capture this and other metrics on a per request level and store the details for any request lasting longer than 5 sec. For the rest we only keep a rolling summary by account and group who submitted the request(s). On demand we can drill down to step level detail that allows us to look at individual sorts, redistributions, aggregations and so on. This information is then leveraged by the system priority manager and queuing engine to manage millions of requests per day according to predefined processing budgets. And for efficiency sakes we calculate Amdahl-like (see my latest blog post from CCA08 ) numbers as well as Parallel Efficiency on a per request level as well as group and system level. Have a great day! Oliver - Oliver Ratzesberger Fri, 24 Oct 2008 01:40:46 +0100 http://www.xlmpp.com/blog/Cost-.html#comment-7 Hey Michael, Glad to see you guys blogging again! When I was at Facebook, these licensing schemes definitely played a role in our choice of Hadoop as an attractive option for analytics. There were other reasons, of course, but the pricing model played a role. You mentioned at the XLDB meetup that you meter by the CPU second at eBay. Would you recommend this metric for billing by data warehousing customers? If not, what pricing schemes would you like to see? Regards, Jeff - Jeff Thu, 23 Oct 2008 17:58:20 +0100