Nabarun Chakraborti
1 min readOct 5, 2020

--

Here I tried to cover most common scenarios. There may be lot of other combinations of input file. Anyhow what you are saying is correct, and we can use 'from_json' instead of 'json_tuple' with dynamic schema creation based on the input types (row wise)

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Nabarun Chakraborti
Nabarun Chakraborti

Written by Nabarun Chakraborti

Big Data Solution Architect and pySpark Developer

No responses yet

Write a response