PinnedNabarun ChakrabortiApache Spark Optimization TechniquesBefore discuss various optimization techniques have a quick review how does spark run11 min read·Jun 18, 2020--2--2
PinnedNabarun ChakrabortiFew Spark Concepts :You can consider this as one of the reference notebook where will cover the below topics8 min read·Jul 1, 2020--2--2
Nabarun ChakrabortiUnleashing the Power of LLM with Snowflake CORTEXSnowflake Cortex, now available in private preview, stands as Snowflake’s latest innovation, delivering intelligent data analysis and AI…8 min read·Mar 26, 2024----
Nabarun ChakrabortiYour Personalized Email Reminder Assistant (Windows m/c)— Using PythonIn the hustle and bustle of our daily lives, it’s common to overlook important emails amid the chaos of work and daily tasks. But what if…4 min read·Feb 21, 2024--1--1
Nabarun ChakrabortiEnable ETL Using Snowflake Task and Stream — Super EasyIn this article I will try to explain how task and stream can be easily clubbed together to execute ETL pipeline.7 min read·Jan 9, 2024----
Nabarun ChakrabortiCaching Data using PythonWe all know that caching is basically keeping the important/most popular data in memory rather than in a disk for faster execution. But…4 min read·Jun 12, 2021----
Nabarun ChakrabortiHow to Encrypt and Decrypt application password using PythonThere are scenarios when we are using application password in our code. This is completely an unethical practice. Password should be…3 min read·Jun 1, 2021--1--1
Nabarun ChakrabortiTrack live position of International Space Station and people in space — using PythonThis is a very basic but powerful python program to track the live position of ISS. My son used to run it in every 30–40 mins interval to…4 min read·Feb 15, 2021--1--1
Nabarun ChakrabortiRead JSON using PySparkThe JSON (JavaScript Object Notation) is a lightweight format to store and exchange data. The input JSON may be in different format —4 min read·Oct 4, 2020--2--2
Nabarun ChakrabortiAPACHE SPARK AND DELTA LAKE, A POWERFUL COMBINATIONSpark is no doubt a powerful processing engine and a distributed cluster computing framework for faster processing. It is getting enriched…13 min read·Sep 23, 2020--1--1