Whitepaper from Amazon describing how to build more scalable web applications using their Simple Queuing Service (SQS).
1 FaverShareViewed: 3 TimesProvides 99.9% SLA, phone support (pay), allegedly better API & management than Amazon S3. $0.18/GB. Intel just invested in them.
1 FaverShareViewed: 4 TimesAn AWS evangelist is going to be hanging out at Startpad once a month starting June 24th!
2 FaversShareViewed: 12 TimesThe part I found interesting was the first detailed description of using the MapReduce model to run large-scale Expectation Maximization (EM) computations in parallel. An implementation of this on Hadoop and Amazon EC2 will let you tackle some large scale
1 FaverShareViewed: 9 Times2 FaversShareViewed: 59 TimesQuoted: Save disk space and bandwidth, and increase the reliability of your site by using the Amazon Simple Storage Service (S3) remote storage service to host your media files. You'll also improve the reliability of your site as it serves the increasingly large multimedia files that are so popular in the Web 2.0 world.
Related Content from Around Faves
amazon
-
We added more slots to the video streaming beta ... jump in before they're gone :)
1 FaverViewed: 2 Times - tsupo - May 19 20051 FaverViewed: 17 Times
- mike - Jun 04 20081 FaverViewed: 3 Times
ec2
-
This looks like a great addition to Amazon S3 and EC2 - they now have a way of creating simple tables with up to 256 attribute/value pairs. Support for GET, PUT, DELETE, and QUERY.
There are a number of things missing over a real relational database (or even an ISAM). S3 is a simple "blob" store - where each object get be atomically read and written. SimpleDB gives some simple query capability (for smaller data items - 1K max per attribute).
I also see no way to get ORDERBY functionality and, of course, no aggregate values (SUM, MAX, etc). Sometimes this can be overcome in the application layer, but it will make your application more complex than using a traditional database.
Most importantly, there are no JOIN's in this system. This will require the application to make multiple QUERYs to get the data needed to generate a view.
I found it very interesting that this document states that Amazon promotes developers running traditional databases in EC2. My understanding is that Amazon can arbitrarily wipe the state of any machine on EC2 - which would cause you to have to restore the database from some an S3 or external backup.
Maybe someone who is using EC2 for running a database server can chime in on how well that works for them.
1 FaverViewed: 4 TimesQuoted: Amazon SimpleDB - a web service for running queries on structured data in real time. Provides the core functionality of a database - real-time lookup and simple querying of structured data - without the operational complexity
- mohit - 30 days ago1 FaverViewed: 3 Times
- n.takushima - Sep 20 20072 FaversViewed: 3 Times
