Java and Scala File and Directory Handling
Scala – How to open and read files in Scala How to write to file in Java – BufferedWriter Java File: Reading and Writing Files in Java org.apache.commons.io.FileUtils Example...
View ArticleExecuting R scripts from within a Spark job
Executing existing R scripts from Spark Executing R scripts from within a Spark job
View ArticleExecute (exec) external system shell commands in Scala
How to execute (exec) external system commands in Scala The scala.sys.proces package scala.sys.process.ProcessBuilder How to execute external commands and use their STDOUT in Scala 12.11. Executing...
View ArticleIterating Collections in Scala
Iterating over Scala Lists with foreach and for Iterating over Scala Maps (for and foreach loop examples) Iterating over Map with Scala Iterating Maps in Scala
View ArticleCassandra Spark Working with CSV’s, TSV’s
Using Apache Spark DataFrames for Processing of Tabular Data Working with CSV / TSV files in Spark Import TSV File in spark Importing a Text File into a CQL Table Saving data to Cassandra
View ArticleAnonymous Functions in Scala
Anonymous Function Syntax Scala – Passing a function literal as a function argument 9.2. Using Functions as Variables Don’t Use Return in Scala Fun With Scala Functions
View ArticleScala Java Conversions
Conversions Between Java and Scala Collections scala.collection.JavaConversions api docs
View ArticleScala headOption
Prefer headOption to Head in Scala Collection Scala headOption example
View ArticleScala Regex Stuff
Scala: How to extract parts of a string that match a regex scala.util.matching.Regex Safari Scala Cookbook – 1.6. Finding Patterns in Strings Daily Scala – Regular Expression 1 : Basics and findAllIn
View ArticleJetty’s Server in Spark Stack
Spark has a web accessible monitoring interface, as well as, several other mechanisms like remoting, and file-serving that use http protocols. Spark uses the Jetty web server, client and java servlet...
View ArticleHow to generate TimeUUID in Java/Scala for Cassandra
How to generate TimeUUID in Java/Scala UUIDGen.java
View ArticleReflective Instantiation of Classes at Runtime
Dynamic and Reflective Variable and Method Processing Roughly stated, Reflection is the ability for a program to inspect properties of itself and dynamically identify and invoke particular variables...
View ArticleSpark Programmatic Node Communication
Distributed Computing Distributed and parallel data processing has been discussed and explained a million different ways in a million different places, so we’ll keep it brief here. Some of the best...
View Article
