Skip to content

Posts tagged ‘Amazon Web Services’

Building a High Performance Cluster with Amazon Web Services

[tweetmeme source=@LouisColumbus only_single=false]

Amazon Web Services has released the following video that provides a fascinating look at how straightforward it is to create, launch and monitor high performance cluster instances.

CPU utilization, disk I/O and network utilization are tracked as part of the metrics, and guidance on how to define hardware virtualization (HVM) is also defined.   Creating an 8-node, 64 core, ad hoc cluster is defined in the steps in this video with the intent of running a molecular dynamics simulation.

What is interesting about this video is how Amazon Web Services continues to show the practicality of its broad spectrum of server capacities on the Elastic Compute Cloud (EC2).   This is the first in a series of videos Amazon Web Services will be releasing on creating high performance clusters.  It’s worth checking out as the walk-through of steps shows how rapidly EC2 is maturing as an enterprise platform.

Implications for the Enterprise

EC2 has language-agnostic Web Services APIs that show potential for integrating legacy systems, databases, master data management (MDM), CRM and enterprise systems.  For enterprises that have data-centric operations and business models, EC2 could become the foundation of contextual search and role-based access of their legacy data.  Decades of data accessed via contextual search would provide insights that aren’t possible today using existing methods of data access, integration and analysis.

Bottom line: Creating high performance clusters in AWS EC2 shows potential to increase the accuracy and precision of business intelligence and analytics, and potentially solve the most complex data-driven challenges of social CRM.

Flickr attribution: http://www.flickr.com/photos/vitroids/2586785504/

Web 2.0 Summit 2010 Point of Control: The Cloud

[tweetmeme source=@LouisColumbus only_single=false]

O’Reilly Media and UBM TechNet sponsored the Web 2.0 Summit 2010 held in San Francisco from November 15th to 19th.  This event has become one of the premier conferences globally due to the quality of the content and speakers it attracts, and the thought leadership of the concepts presented there.

The following panel discussion includes Marc Benioff, Founder and CEO of Salesforce.com; Andy Jassy, SVP of Amazon Web Services and Amazon Infrastructure; Paul Maritz, President and CEO of VMware and Tim O’Reilly, founder and CEO of O’Reilly Media, Inc.

The discussion is on the aspects of application independence in Cloud environments, the future direction of cloud integration technologies, and the emergence of Cloud-based operating system.

http://www.youtube.com/watch?v=yKUFJImt7Qg

You can find the site by clicking on the Web 2.0 Summit Points of Control map below.

Google Cloud Technologies Overview

[tweetmeme source=@LouisColumbus only_single=false]

Google’s efforts at App Engine evangelism continue to accelerate with the announcement of new APIs and products from Google Labs.

The complete listing of Products in Labs and Graduates of Labs are listed on the Google Code Labs site.
Where Amazon Web Services (AWS) changes many different elements of their platform, pricing, and services often, Google is taking an incremental approach to rolling out new features based on innovation and extensive work in Google Labs.

The following slide deck authored by Chris Schalk is case in point.  Included in this presentation is an update on the Google Storage, Google Prediction API, and Google Big Query.  It’s an excellent overview of these APIs and services, explaining the evolving role of Google’s cloud technologies in the process.

High Performance Computing on AWS – Keynote for SC10 by Dr. Werner Vogels, CTO of Amazon

[tweetmeme source=@LouisColumbus only_single=false]

Dr. Werner Vogel’s pre-recorded keynote for SC10 provides insights into the early adopters of the latest generation of AWS enhancements and additions.  SC10 is the leading conference globally for high performance computing, networking, storage and analysis.

His co-presenter is Deepak Singh, Sr. Business Development Manager who describes the role of Hadoop MapReduce in the AWS strategy.  At just over eight minutes, this keynote is worth watching for the insights and updates on the latest customer and technology news on AWS .

http://www.youtube.com/watch?v=rnOGzKP4Vdc

Amazon Announces S3 Storage Price Reduction

[tweetmeme source=@LouisColumbus only_single=false]

Amazon Web Services announced a new pricing schedule for S3 storage that takes place immediately today, November 1rst.  Existing customers could see as much as a 19% reduction in monthly fees.  Amazon also created a new pricing tier at the 1TB level and have also deleted the current 50 – 100 TB tier.  Amazon says these pricing changes apply to the US Standard, EU – Ireland, and APAC – Singapore regions.

The full price list can be found on the Amazon Simple Storage Service (Amazon S3) page here .

AWS link: http://aws.typepad.com/aws/2010/11/what-can-i-say-another-amazon-s3-price-reduction.html

Flickr attribution: http://www.flickr.com/photos/timparkinson/930660427/sizes/m/in/photostream/

Overview of Amazon Web Services Security Processes

[tweetmeme source=@LouisColumbus only_single=false]

AWS’ Chief Information Security Officer Stephen Schmidt released this presentation last week on slideshare.net.  At 27 pages, this presentation is packed full of excellent content and great information on the direction AWS is going on for ensuring security and compliance.  He discusses certifications, SAS70 Type II security, physical security, Amazon EC2, network, S3, Simple DB, and SQS security topics as well.  He also covers CloudFront and Elastic MapReduce security initiatives and plans.

It is a great tutorial to the strategies and initiates AWS is pursuing to make their platforms scalable, secure and reliable.   Be sure to check out this page on the AWS site for more information on security: http://aws.amazon.com/security.

Netflix in the Cloud – Lessons Learned Deploying AWS

[tweetmeme source=@LouisColumbus only_single=false]

Adrian Cockcroft, Cloud Architect at Netflix recently published a summary slide deck of a presentation he will be giving on November 3rd at QConSF.  It is a fascinating look into how Netflix chose AWS and the lessons learned.  Adrian discusses the presentation on his blog here.

It is going to be very interesting to see the entire slide deck after QConSF, which is when Adrian plans to upload it per a note on his blog.

Test Driving An Amazon EC2 Micro Instance

[tweetmeme source=@LouisColumbus only_single=false]

Last month Amazon Web Services launched Micro Instances for EC2, the lowest-cost instance type they have offered to date.  A Micro instance includes 613MB of memory and can support 32- and 64-bit platforms on both Linux and Windows operating systems.

The pricing begins at $0.02 per hour for Linux and $0.03 per hour for Windows.  In addition, a Micro instance supports Amazon Machine Image (AMI) for defining applications, data structures and databases in addition to configurations.  Amazon is also including a templated image to get up and running quickly with a Micro instance as well.

Greg Wilson, who is a Sr. Technical Evangelist for Adobe Systems, produced one of the best tutorials and test drives available, which is shown below. He has also written a blog entry regarding lessons learned which can be found at My dive into the world of Amazon EC2 and the new crazy cheap Micro instance.

Bottom line: Micro instances are going to shift cloud-based development away from compute- and data-intensive application development to smaller applications and web services.  Given the price point, the use of Micro instances could lead to a proliferation of new low-end, utilitarian-like applications as well.

Update on Amazon Web Services (AWS) and Alexa GrepTheWeb Service

[tweetmeme source=@LouisColumbus only_single=false]

The following presentation from Amazon Web Services’ (AWS) Jinesh Varia includes an update on the Alexa GrepTheWeb Service and an excellent overview of AWS components. There is also an update on the AWS cloud architecture and definition of the Compute (EC2), messaging (SQS) and Storage (S3, Simple DB, and EC2-EBS) component integration.

Finally there are an interesting series of slides explaining courses at University of California, Santa Barbara and Stanford University on how AWS is being used to teach data mining and related topics.

This presentation also provides insights into how configurations of AWS can be customized for data mining and content management.

Disclaimer: Amazon and AWS are not clients of mine by the way.  When I write about vendors who are, I will be sure to mention it.

Ingram Micro Seeing Traction with Cloud Conduit Initiative

Bottom line: Reselling cloud computing services shows much potential as a market for technology platform and application providers. The challenge is the ability to tailor the services mix efficiently and accurately enough to capitalize on scalability and selective demand of mid-tier and small business end users.

Read more