https://jgp.ai/2019/01/30/almost-all-you-need-to-know-about-file-ingestion-in-apache-spark/