ByteByteGo Newsletter

Share this post

Which cloud provider should be used when building a big data solution?

blog.bytebytego.com

Discover more from ByteByteGo Newsletter

Explain complex systems with simple terms, from the authors of the best-selling system design book series. Get 158 page System Design PDF, FREE
Over 590,000 subscribers
Continue reading
Sign in

Which cloud provider should be used when building a big data solution?

Alex Xu
Apr 7, 2022
28
Share this post

Which cloud provider should be used when building a big data solution?

blog.bytebytego.com
Share

Which cloud provider should be used when building a big data solution?

The diagram below illustrates the detailed comparison of AWS, Google Cloud, and Microsoft Azure.

The common parts of the solutions:

1. Data ingestion of structured or unstructured data.

2. Raw data storage.

3. Data processing, including filtering, transformation, normalization, etc.

4. Data warehouse, including key-value storage, relational database, OLAP database, etc.

5. Presentation layer with dashboards and real-time notifications.

It is interesting to see different cloud vendors have different names for the same type of products.

For example, the first step and the last step both use the serverless product. The product is called “lambda” in AWS, and “function” in Azure and Google Cloud.

Question - which products have you used in production? What kind of application did you use it for?


If you enjoyed this post, you might like our system design interview books as well.

SDI-vol1: https://amzn.to/3tK0qQn

SDI-vol2: https://amzn.to/37ZisW9

28
Share this post

Which cloud provider should be used when building a big data solution?

blog.bytebytego.com
Share
Comments
Top
New
Community

No posts

Ready for more?

© 2023 ByteByteGo
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing