Amazon Web Services: Building Highly Scalable Web Applications Institutional Web Management Workshop July 2007 Jeff Barr Senior Web Services Evangelist jbarr@amazon. com
Today Introduction Amazon Web Services overview Amazon EC 2 Amazon S 3 Amazon SQS Application Architecture Questions
Who am I? Software development background 5 Years with Amazon: Senior Developer Web Services Evangelist Senior Web Services Evangelist Veteran of several startups Microsoft. Net Team Visix Software co-founder
Amazon? Consumers (Buy) Associates, Sellers & Merchants (Sell) Developers (Innovate)
Issues Facing Developers 70% of Web Development Effort is “Muck”: Data Centers Bandwidth / Power / Cooling Operations Staffing Scaling is Difficult and Expensive: Large Up-Front Investment Invest Ahead of Demand Load is Unpredictable
Dream or Nightmare? Slashdot/Digg/Tech. Crunch Effect Rapid, unexpected customer demand/growth
Seasonal Spikes
More Seasonal Spikes “Every year, we take the busiest minute of the busiest hour of the busiest day and build capacity on that, we built our systems to (handle that load) and we went above and beyond that. ” * -- Scott Gulbransen Intuit Spokesman * http: //news. com/2100 -1038_3 -6177341. html
Solution: Web-Scale Computing Scale capacity on demand Turn fixed costs into variable costs Always available Rock-solid reliability Simple APIs and conceptual models Cost-effective Reduced time to market Focus on product & core competencies
Amazon Web Services Are. . . A set of APIs and business models which give developer-level access to Amazon’s infrastructure and content: Data As A Service Amazon E-Commerce Service Amazon Historical Pricing Infrastructure As A Service Amazon Simple Queue Service Amazon Simple Storage Service Amazon Elastic Compute Cloud Search As A Service Alexa Web Information Service Alexa Top Sites Alexa Site Thumbnail Alexa Web Search Platform People As A Service Amazon Mechanical Turk 10
The Commercial Side Standard licensing terms Commercially usable Aggressive pricing Monthly credit card billing Self-serve model: Sign up as developer Choose services Agree to service licenses Enter payment info Start coding
Web Services Billing
Infrastructure Services Elastic Compute Cloud Compute Simple Storage Service Store Simple Queue Service Message
Amazon Simple Storage Service S 3
Amazon Simple Storage Service • Object-Based Storage • 1 B – 5 GB / object • Fast, Reliable, Scalable • Redundant, Dispersed • 99. 99% Availability Goal • Private or Public • Per-object URLs & ACLs • Bit. Torrent Support $. 15 per GB per month storage $. 01 for 1000 to 10000 requests $. 10 - $. 18 per GB data transfer
Amazon S 3 Concepts Objects: Opaque data to be stored (1 byte … 5 Gigabytes) Authentication and access controls Buckets: Object container – any number of objects 100 buckets per account / buckets are “owned” Keys: Unique object identifier within bucket Up to 1024 bytes long Flat object storage model Standards-Based Interfaces: REST and SOAP URL-Addressability – every object has a URL
S 3 SOAP/Query API Service: List. All. My. Buckets: Create. Bucket Delete. Bucket List. Bucket Get. Bucket. Access. Control. Policy Set. Bucket. Access. Control. Policy Get. Bucket. Logging. Status Set. Bucket. Logging. Status Objects: Put. Object. Inline Get. Object. Extended Delete. Object Get. Object. Access. Control. Policy Set. Object. Access. Control. Policy
Amazon Simple Queue Service SQS
Amazon Simple Queue Service • Scalable Queuing • Elastic Capacity • Reliable, Simple, Secure $. 10 per 1000 messages Inter-process messaging, data buffering, architecture component $. 10 - $. 18 per GB data transfer
Amazon SQS Concepts Queues: Named message container Persistent Messages: Up to 256 KB of data per message Peek / Lock access model Scalable: Unlimited number of queues per account Unlimited number of messages per queue
Amazon SQS At Work
SQS SOAP/Query API Queues: List. Queues Delete. Queue Set. Visibility. Timeout Get. Visibility. Timeout Messages: Send. Message Receive. Message Delete. Message Peek. Message Security: Add. Grant List. Grants Remove. Grant
Amazon Elastic Compute Cloud EC 2
Amazon Elastic Compute Cloud • Virtual Compute Cloud • Elastic Capacity • 1. 7 GHz x 86 • 1. 7 GB RAM • 160 GB Disk • 250 MB/Second Network • Network Security Model Time or Traffic-based Scaling, Load testing, Simulation and Analysis, Rendering, Software as a Service Platform, Hosting $. 10 per server hour $. 10 - $. 18 per GB data transfer
Amazon EC 2 Concepts Amazon Machine Image (AMI): Bootable root disk Pre-defined or user-built Catalog of user-built AMIs OS: Fedora, Centos, Gentoo, Debian, Ubuntu, Windows Server App Stack: LAMP, mpi. BLAST, Hadoop Instance: Running copy of an AMI Launch in less than 2 minutes Start/stop programmatically Network Security Model: Explicit access control Security groups Inter-service bandwidth is free
Amazon EC 2 At Work Startups Cruxy – Media transcoding Giga. Vox Media – Podcast Management Fortune 500 clients: High-Impact, Short-Term Projects Development Host Science / Research: Hadoop / Map. Reduce mpi. BLAST Load-Management and Load Balancing Tools: Pound Weogeo Rightscale
EC 2 SOAP/Query API Images: Register. Image Describe. Images Deregister. Image Instances: Run. Instances Describe. Instances Terminate. Instances Get. Console. Output Reboot. Instances Keypairs: Create. Key. Pair Describe. Key. Pairs Delete. Key. Pair Image Attributes: Modify. Image. Attribute Describe. Image. Attribute Reset. Image. Attribute Security Groups: Create. Security. Group Describe. Security. Groups Delete. Security. Group Authorize. Security. Group. Ingress Revoke. Security. Group. Ingress
Sample Web-Scale Architecture Giga. Vox Media
Web-Scale Architecture
Giga. Vox Economics Implemented Amazon S 3, Amazon EC 2 and Amazon SQS in November 2006 Created an infinitely scalable infrastructure for less than $100 - building the same infrastructure themselves would have cost thousands of dollars Reduced staffing requirements - far less responsibility for 24 x 7 operations
Q&A
Thank You! Jeff Barr Senior Web Services Evangelist jbarr@amazon. com Pointers Portal http: //aws. amazon. com Blog http: //aws. typepad. com EC 2 http: //aws. amazon. com/ec 2 S 3 http: //aws. amazon. com/s 3 Resource Center http: //aws. amazon. com/resources Forums http: //aws. amazon. com/forums
Скачать презентацию Amazon Web Services Building Highly Scalable Web Applications
eca7c0245969c9a8527d8d8e70054d20.ppt