https://www.thecodersstop.com/spark/generate-sequential-and-unique-ids-in-a-spark-dataframe/
Generate Sequential and Unique IDs in a Spark Dataframe