Pyspark Get Size Of Dataframe In Gb, Unfortunately it seems that something changed in PySpark internals.