When you start an application, you need to think about where it’s going to run, and also how it’s going to run. Basically, the way I use Spark is in…
Managing Java UDF with Apache Spark
UDF stands for User Defined Functions. With those, you can easily extend Apache Spark with your own routines and business logic. Let’s see how we can build them and deploy…
Spark Java Recipes
Here are a few quick recipes to solve some common issues with Apache Spark. All examples are based on Java 8 (although I do not use consciously any of the…
Chapel Hill, we *Don’t* Have a Problem…
Successful first deployment of Apache Spark on a production server. Yep… I could add the line on my resume. Right now, we have set 24 cores, 72 GB of memory…
Spark is a Hadoop Killer
Of course, nobody will tell you I am right. At least officially. But at was what was goal of Hadoop? Perform analytics over a wide range of servers. Of course,…
Your Very First Apache Spark Application
Here is your very first Apache Spark program using Java: the equivalent of the Kernighan and Ritchie’s “Hello, World”. You can download it from GitHub: Basically, the key is to…
Business Agility, or how IT Should Inspire Business
This morning, I hit the road for a quick 20-minute ride to RTP (Research Triangle Park), to attend a workshop on business agility, organized by Eliassen Group. Animated and moderated…
The Apache Ecosystem for Enterprise Applications
The Apache Software Foundation (ASF) offers a wide range of tools, libraries, frameworks, and data stores for building enterprise applications. The purpose of this list is to keep track of…
Kids Too
As I live the American public school system, I see a little more how it works and made contacts there. It’s a bit the same as when you read about…
Failure to Update Raspbian Using apt-get
I had a system crash with my Raspberry Pi during an update process. As a result the disk was corrupted and I needed to fix the trusted GPG keys as…