On September 15th, 2021, after more than 18 months, I was finally able to give a talk in person. My conference schedule did not really go down during the pandemic, […]
Bringing vision to Apache Spark
Drsti (pronounced drishti) is an effortless data visualization that interfaces easily with Apache Spark
Do your best work ever for Call for Code
I have been a mentor and judge for Call for Code. However, this year, I have other projects limiting my time to contribute to this world-changing initiative. That’s why I […]
Building Enterprise Software Today
I am an enterprise architect. Among the things I work on, I am bridging technology and business at the enterprise level. When I am on the technology side, I am talking to a lot of engineers and architects of various levels. When I am on the business side, I am trying to explain our technology constraints. That’s why I wanted to level-set vocabulary and concepts that I considered critical. I have cut the content into three twenty-minute videos available on YouTube.
Get your own copy of Spark in Action 2e
Spark in Action, second edition, has been out for about a month and was running a little low in some stores, so here is a convenient list of stores where […]
Having a Smart Summer Thanks to IBM
As I am a rising senior in high school with a lot of time on my hands, I am able to look into different areas of engineering to see what […]
Hot July planning
Despite 2020 being a mess so far, and after a very calm period in terms of events, it’s time to get back on stage. I will have two similar events, […]
Keep your family updated using MagicMirror
In this article, you will find a list of hardware for this project, where to go to download it, and how to customize it to fit your needs and/or your […]
Awaited Apache Spark v3.0.0 is finally released
Apache Spark v3.0.0 has been released on June 18th, 2020, just before Spark + AI Summit 2020, which is being held virtually this year (like most big conferences). Spark v3 […]
DataFriday: manipulating the schemas of Spark dataframes
In this fifth episode of DataFriday, I will dig into the schema linked to each dataframe in Apache Spark. I will rename columns, create columns, and analyze the result. I […]