[cs615asa] Workshop for AWS Real time streaming
Tianpei Luo
tluo4 at stevens.edu
Sat May 6 02:12:08 EDT 2017
Hello All,
Originally I supposed to share the thoughts about the event of New York SRE
Tech Talks, since it may be too boring to repeat this again and besides I
am also quite confusing about some technical term that been
mentioned.Hence,I decided to attend another one for this week which is an
introduction to Real time streaming and Amazon Kinesis.
The talks in the morning session is based on three topic: 1. What is real
time streaming? 2. What is the insight of using the AWS kinesis for
business? 3.How to analyze streaming data with standard SQL using Amazon
Kinesis Analytics framework. It is basically gave me high-level view to
those frameworks with a simply graphic representation.The whole process can
be conclude to a single chain, first of all is getting the real time data
form sensor and then ingest the sensor data into Amazon kinesis
stream.Processing and compute sensor data metrics with the analytics
function of this stream, technically it is using standard SQL to do the
aggregation or processing.Last, the streams need a management tool which is
called kinesis firehose, it can capture and load streaming data into other
amazon services like Amazon redshift or Elasticserch service.
The second part is the workshop that building a simple streaming. It will
be totally free to run those services with the credit that provided by the
staff which is quite sweet. Building this application is quite simple by
following the instruction and I don't have to use any command line or
knowing any programming language to use those API.The only thing I need to
do is to write some SQL for aggregating the data by the time stamp and run
those data into amazon Elasticserch service.
Then I could able to look those fancy data with visualization.
What I learned?
It is really hard to answer. I could said I learn a lot or nothing.
Thanks for reading if you read until here. XD
Tianpei Luo
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.stevens.edu/pipermail/cs615asa/attachments/20170506/152142a8/attachment.html>
More information about the cs615asa
mailing list