spark3.5.1中内置函数大全

本文涉及的产品
智能开放搜索 OpenSearch行业算法版,1GB 20LCU 1个月
实时计算 Flink 版,5000CU*H 3个月
实时数仓Hologres,5000CU*H 100GB 3个月
简介: spark3.5.1中内置函数大全

spark3.5.1中内置函数大全

abs

acos

acosh

add_months

aes_decrypt

aes_encrypt

aggregate

and

any

any_value

approx_count_distinct

approx_percentile

array

array_agg

array_append

array_compact

array_contains

array_distinct

array_except

array_insert

array_intersect

array_join

array_max

array_min

array_position

array_prepend

array_remove

array_repeat

array_size

array_sort

array_union

arrays_overlap

arrays_zip

ascii

asin

asinh

assert_true

atan

atan2

atanh

avg

base64

between

bigint

bin

binary

bit_and

bit_count

bit_get

bit_length

bit_or

bit_xor

bitmap_bit_position

bitmap_bucket_number

bitmap_construct_agg

bitmap_count

bitmap_or_agg

bool_and

bool_or

boolean

bround

btrim

cardinality

case

cast

cbrt

ceil

ceiling

char

char_length

character_length

chr

coalesce

collect_list

collect_set

concat

concat_ws

contains

conv

convert_timezone

corr

cos

cosh

cot

count

count_if

count_min_sketch

covar_pop

covar_samp

crc32

csc

cume_dist

curdate

current_catalog

current_database

current_date

current_schema

current_timestamp

current_timezone

current_user

date

date_add

date_diff

date_format

date_from_unix_date

date_part

date_sub

date_trunc

dateadd

datediff

datepart

day

dayofmonth

dayofweek

dayofyear

decimal

decode

degrees

dense_rank

div

double

e

element_at

elt

encode

endswith

equal_null

every

exists

exp

explode

explode_outer

expm1

extract

factorial

filter

find_in_set

first

first_value

flatten

float

floor

forall

format_number

format_string

from_csv

from_json

from_unixtime

from_utc_timestamp

get

get_json_object

getbit

greatest

grouping

grouping_id

hash

hex

histogram_numeric

hll_sketch_agg

hll_sketch_estimate

hll_union

hll_union_agg

hour

hypot

if

ifnull

ilike

in

initcap

inline

inline_outer

input_file_block_length

input_file_block_start

input_file_name

instr

int

isnan

isnotnull

isnull

java_method

json_array_length

json_object_keys

json_tuple

kurtosis

lag

last

last_day

last_value

lcase

lead

least

left

len

length

levenshtein

like

ln

localtimestamp

locate

log

log10

log1p

log2

lower

lpad

ltrim

luhn_check

make_date

make_dt_interval

make_interval

make_timestamp

make_timestamp_ltz

make_timestamp_ntz

make_ym_interval

map

map_concat

map_contains_key

map_entries

map_filter

map_from_arrays

map_from_entries

map_keys

map_values

map_zip_with

mask

max

max_by

md5

mean

median

min

min_by

minute

mod

mode

monotonically_increasing_id

month

months_between

named_struct

nanvl

negative

next_day

not

now

nth_value

ntile

nullif

nvl

nvl2

octet_length

or

overlay

parse_url

percent_rank

percentile

percentile_approx

pi

pmod

posexplode

posexplode_outer

position

positive

pow

power

printf

privacy

quarter

radians

raise_error

rand

randn

random

rank

reduce

reflect

regexp

regexp_count

regexp_extract

regexp_extract_all

regexp_instr

regexp_like

regexp_replace

regexp_substr

regr_avgx

regr_avgy

regr_count

regr_intercept

regr_r2

regr_slope

regr_sxx

regr_sxy

regr_syy

repeat

replace

reverse

right

rint

rlike

round

row_number

rpad

rtrim

schema_of_csv

schema_of_json

sec

second

sentences

sequence

session_window

sha

sha1

sha2

shiftleft

shiftright

shiftrightunsigned

shuffle

sign

signum

sin

sinh

size

skewness

slice

smallint

some

sort_array

soundex

space

spark_partition_id

split

split_part

sqrt

stack

startswith

std

stddev

stddev_pop

stddev_samp

str_to_map

string

struct

substr

substring

sum

tan

tanh

timestamp

timestamp_micros

timestamp_millis

timestamp_seconds

tinyint

to_binary

to_char

to_csv

to_date

to_json

to_number

to_timestamp

to_timestamp_ltz

to_timestamp_ntz

to_unix_timestamp

to_utc_timestamp

to_varchar

transform

transform_keys

transform_values

translate

trim

trunc

try_add

try_aes_decrypt

try_avg

try_divide

try_element_at

try_multiply

try_subtract

try_sum

try_to_binary

try_to_number

try_to_timestamp

typeof

ucase

unbase64

unhex

unix_date

unix_micros

unix_millis

unix_seconds

unix_timestamp

upper

url_decode

url_encode

user

uuid

var_pop

var_samp

variance

version

weekday

weekofyear

when

width_bucket

window

window_time

xpath

xpath_boolean

xpath_double

xpath_float

xpath_int

xpath_long

xpath_number

xpath_short

xpath_string

xxhash64

year

zip_with

相关文章
|
存储 分布式计算 并行计算
大数据Spark RDD 函数 1
大数据Spark RDD 函数
105 0
|
4月前
|
SQL 分布式计算 数据处理
MaxCompute操作报错合集之使用Spark查询时函数找不到的原因是什么
MaxCompute是阿里云提供的大规模离线数据处理服务,用于大数据分析、挖掘和报表生成等场景。在使用MaxCompute进行数据处理时,可能会遇到各种操作报错。以下是一些常见的MaxCompute操作报错及其可能的原因与解决措施的合集。
|
分布式计算 Java Spark
图解Spark Graphx实现顶点关联邻接顶点的collectNeighbors函数原理
图解Spark Graphx实现顶点关联邻接顶点的collectNeighbors函数原理
51 0
|
6月前
|
SQL 分布式计算 Spark
Spark【Spark SQL(四)UDF函数和UDAF函数】
Spark【Spark SQL(四)UDF函数和UDAF函数】
|
分布式计算 大数据 数据挖掘
大数据Spark RDD 函数 2
大数据Spark RDD 函数
96 0
|
SQL JSON 分布式计算
spark2 sql读取数据源编程学习样例2:函数实现详解
spark2 sql读取数据源编程学习样例2:函数实现详解
90 0
spark2 sql读取数据源编程学习样例2:函数实现详解
|
SQL 存储 分布式计算
Spark强大的函数扩展功能
Spark强大的函数扩展功能
|
分布式计算 Java Linux
【Spark 3.0-JavaAPI-pom】体验JavaRDD函数封装变化
【Spark 3.0-JavaAPI-pom】体验JavaRDD函数封装变化
191 0
【Spark 3.0-JavaAPI-pom】体验JavaRDD函数封装变化
|
分布式计算 Java Scala
一天学完spark的Scala基础语法教程四、方法与函数(idea版本)
一天学完spark的Scala基础语法教程四、方法与函数(idea版本)
95 0
一天学完spark的Scala基础语法教程四、方法与函数(idea版本)
|
SQL 缓存 分布式计算
spark2的SparkSession思考与总结2:SparkSession有哪些函数及作用是什么
spark2的SparkSession思考与总结2:SparkSession有哪些函数及作用是什么
285 0