Apache Spark Architecture Overview: Jobs, Stages, Tasks, etc
03 Jan 2017 Quick overview of the main architecture components involved in running spark jobs, so you can better understand how to make the best possible use of resources.
HDFS Commands: Reference and Examples
25 Dec 2016 List of HDFS commands for filesystem management, along with common use cases.
Read More ›technology ubuntu 16.04 cuda tensorflow
Installing CUDA TK 8 and Tensorflow on a Clean Ubuntu 16.04 Install
24 Dec 2016 Guiding you through installing the correct NVIDIA drivers, CUDA, cuDNN and tensorflow on an Ubuntu 16.04 box.
AWS Kinesis Common Operations using the AWS CLI: Reference & Examples
21 Dec 2016 A couple of commands you can issue to a Kinesis stream from the AWS cli.
Read More ›Typescript Examples: Type Casting and Type Conversions
20 Dec 2016 Examples on how to convert between types and/or cast in Typescript.
Read More ›Commonly-used Docker Commands: Reference and Examples
15 Dec 2016 Docker commands you'll find yourself using often. Things like build images, starting containers, accessing containers, etc.
Read More ›Spark Streaming: Commong Pitfalls and Tips for Long-running Streaming Applications
11 Dec 2016 Running Spark Streaming applications may introduce a couple of problems that you may not face when you are running Spark on Batch mode.
Here are a couple of things you may need to take into account to keep long-running spark streaming jobs running smoothly.
Bash Regular Expressions: Reference and Examples
04 Dec 2016 Lots of examples on how to use regular expressions with bash scripts.
Read More ›ApplicationAttemptNotFoundException: Spark Application Stuck in ACCEPTED state on YARN
13 Nov 2016 ApplicationAttemptNotFoundException may be cause because the log directory have become too crowded with data.
Read More ›