SamuelLance73's picture
download
raw
575 Bytes
# What is this directory?
* In order to perform certain functions, spark sometimes needs to write temporary data to the disk.
* Previously, a temporary directory provided by the operating system was used for this purpose.
* However, this proved to be unreliable in some circumstances, so spark now stores temporary data here instead!
spark will automatically cleanup the contents of this directory.
(but if for some reason it doesn't, if the server is stopped, you can freely delete any files ending in .tmp)
tl;dr: spark uses this folder to store some temporary data.

Xet Storage Details

Size:
575 Bytes
·
Xet hash:
2997ad5d35976ca22dd3c055207307d891b9c56ab8644e48bc4851c7e6d9b215

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.