pyspark.sql.functions.unix_millis#

pyspark.sql.functions.unix_millis(col)[source]#

Returns the number of milliseconds since 1970-01-01 00:00:00 UTC. Truncates higher levels of precision.

New in version 3.5.0.

Parameters

colColumn or column name: input column of values to convert.

Returns

Column: the number of milliseconds since 1970-01-01 00:00:00 UTC.

See also

pyspark.sql.functions.unix_date()
pyspark.sql.functions.unix_seconds()
pyspark.sql.functions.unix_micros()
pyspark.sql.functions.timestamp_millis()

Examples

>>> spark.conf.set("spark.sql.session.timeZone", "America/Los_Angeles")

>>> import pyspark.sql.functions as sf
>>> df = spark.createDataFrame([('2015-07-22 10:00:00',), ('2022-10-09 11:12:13',)], ['ts'])
>>> df.select('*', sf.unix_millis(sf.to_timestamp('ts'))).show()
+-------------------+-----------------------------+
|                 ts|unix_millis(to_timestamp(ts))|
+-------------------+-----------------------------+
|2015-07-22 10:00:00|                1437584400000|
|2022-10-09 11:12:13|                1665339133000|
+-------------------+-----------------------------+

>>> spark.conf.unset("spark.sql.session.timeZone")