Comments on: How EC2 changes the game in batch grid computing http://blog.rightscale.com/2008/04/05/how-ec2-changes-the-game-in-batch-grid-computing/ Cloud Management News & Conversations Thu, 02 Feb 2012 17:49:37 +0000 hourly 1 http://wordpress.com/ By: Stronghold Crusader http://blog.rightscale.com/2008/04/05/how-ec2-changes-the-game-in-batch-grid-computing/#comment-132 Tue, 15 Apr 2008 16:57:12 +0000 http://rightscale.wordpress.com/?p=50#comment-132 Good thread, i like these tips, its looks that i knew just small part.

]]> By: TvE http://blog.rightscale.com/2008/04/05/how-ec2-changes-the-game-in-batch-grid-computing/#comment-80 Tue, 08 Apr 2008 00:04:53 +0000 http://rightscale.wordpress.com/?p=50#comment-80 Kevin, that’s a good point. Right now what we do is keep instances alive until they’re 55 minutes into the hour (to leave a few minutes to actually shut down). This works pretty well in a continuous usage scenario where a queue is getting work pretty much 24×7 and it’s only a matter of adjusting the number of workers up and down with load throughout the day. But if you do one-shot batches where you fill the queue and then have it worked down to empty a lot more planning is needed to avoid having too many instances sitting idle for too long at the end. The key here is find the right trade-off between complexity (=fragility) and actual cost. Wasting an hour on 5-10% of the instances is probably not an issue, specially if the batch runs for several hours. Adding an hour on 100% of the instances may start to affect the bottom line.

]]> By: Kevin http://blog.rightscale.com/2008/04/05/how-ec2-changes-the-game-in-batch-grid-computing/#comment-79 Mon, 07 Apr 2008 23:42:10 +0000 http://rightscale.wordpress.com/?p=50#comment-79 For me, the issue is using as much as possible of the hour, since the whole hour has been bought on Amazon EC2. If you were to fire up lots of instances to finish the queue, and the average instance lifetime was 30 minutes then I’m paying 100% more to Amazon than I need to. So, my point is can you do some clever scheduler stuff to make sure instances live for 59 minutes, or 1 hour 59 minutes, ad infinitum?

]]> By: items for 04.06.2008 « Tzetze Fly http://blog.rightscale.com/2008/04/05/how-ec2-changes-the-game-in-batch-grid-computing/#comment-77 Mon, 07 Apr 2008 15:52:19 +0000 http://rightscale.wordpress.com/?p=50#comment-77 [...] How EC2 changes the game in batch grid computing – RightScale BlogEnter Amazon EC2. If user A enqueues a job needing 500 nodes for 10 hours and user B a job needing 800 nodes for 5 hours what do you do? Very simple: you check the balance in their account and then start 500 instances for user A and 800 instances for user B. Done. No priorities, no scheduling, just pure compute fun! [...]

]]> By: Randy Nichols http://blog.rightscale.com/2008/04/05/how-ec2-changes-the-game-in-batch-grid-computing/#comment-65 Sun, 06 Apr 2008 05:21:29 +0000 http://rightscale.wordpress.com/?p=50#comment-65 Nice Blog. I like the layout you used. Did you make that yourself?

- Randy Nichols.

]]>