Log 조절 Info → WARN
https://stackoverflow.com/questions/25193488/how-to-turn-off-info-logging-in-spark
Kinesis Data Stream에서 읽기
(Medium 유료 가입자용 블로그 링크)
Kinesis Connector for Structured Streaming
https://github.com/qubole/kinesis-sql
KCL 로 DataStream을 Realtime 처리하기
https://github.com/awslabs/amazon-kinesis-client-python
AWS Big Data Platform (괜찮은 내용의 Slideshare)
https://www.slideshare.net/AmazonWebServices/aws-realtime-event-processing
Spark Streaming + Kinesis Integration
https://spark.apache.org/docs/latest/streaming-kinesis-integration.html
Spark Programming Guide
https://spark.apache.org/docs/2.2.0/rdd-programming-guide.html
Spark Streaming Programming Guide
https://spark.apache.org/docs/latest/streaming-programming-guide.html
Scala 예제 (실행 못해봄. 나는 pyspark 로 하고 싶다)
http://blog.zenof.ai/processing-kinesis-data-streams-with-spark-streaming/