Vishakh RameshanJan 17, 20213 min readSpark onto a Next Level with UDFsWhile woking on a technology up-gradation from a legacy application that is built on shell scripts and green plum functions to a...
Vishakh RameshanJan 16, 20212 min read5V's that make data a BIG DATAInternet has been with us for a long time and the number of websites, applications, products have tremendously grown with new inventions...
Vishakh RameshanJan 3, 20211 min readSpark File Format Conversion UtilityI am a Data Engineer performing business operations on Big Data files of various formats like Avro, Parquet, CSV, Text etc on HDFS and...
Vishakh RameshanDec 30, 20202 min readApache Spark Junit Performance ImprovementRecently I was working on a batch application that had series of Spark Jobs running complex business logic. I had written Junit test...
