开发者社区 > 大数据与机器学习 > 实时计算 Flink > 正文

flink1.20.0 部署后发布报错,是怎么回事,各种配置都配置了

下面是我的配置config.yaml,为什么这个taskmanager参数指定了IP,就无法发布成功了?

configured separately for each TaskManager.

host: 192.168.95.113

jobmanager:

The host interface the JobManager will bind to. By default, this is localhost, and will prevent

the JobManager from communicating outside the machine/container it is running on.

On YARN this setting will be ignored if it is set to 'localhost', defaulting to 0.0.0.0.

On Kubernetes this setting will be ignored, defaulting to 0.0.0.0.

#

To enable this, set the bind-host address to one that has access to an outside facing network

interface, such as 0.0.0.0.

bind-host: 0.0.0.0
rpc:

# The external address of the host on which the JobManager runs and can be
# reached by the TaskManagers and any clients which want to connect. This setting
# is only used in Standalone mode and may be overwritten on the JobManager side
# by specifying the --host <hostname> parameter of the bin/jobmanager.sh executable.
# In high availability mode, if you use the bin/start-cluster.sh script and setup
# the conf/masters file, this will be taken care of automatically. Yarn
# automatically configure the host name based on the hostname of the node where the
# JobManager runs.
address: 192.168.95.113
# The RPC port where the JobManager is reachable.
port: 45031

memory:
process:

  # The total process memory size for the JobManager.
  # Note this accounts for all memory usage within the JobManager process, including JVM metaspace and other overhead.
  size: 1600m

execution:

# The failover strategy, i.e., how the job computation recovers from task failures.
# Only restart tasks that may have been affected by the task failure, which typically includes
# downstream tasks and potentially upstream tasks if their produced data is no longer available for consumption.
failover-strategy: region

taskmanager:

The host interface the TaskManager will bind to. By default, this is localhost, and will prevent

the TaskManager from communicating outside the machine/container it is running on.

On YARN this setting will be ignored if it is set to 'localhost', defaulting to 0.0.0.0.

On Kubernetes this setting will be ignored, defaulting to 0.0.0.0.

#

To enable this, set the bind-host address to one that has access to an outside facing network

interface, such as 0.0.0.0.

bind-host: 0.0.0.0

The address of the host on which the TaskManager runs and can be reached by the JobManager and

other TaskManagers. If not specified, the TaskManager will try different strategies to identify

the address.

#

Note this address needs to be reachable by the JobManager and forward traffic to one of

the interfaces the TaskManager is bound to (see 'taskmanager.bind-host').

#

Note also that unless all TaskManagers are running on the same machine, this address needs to be

configured separately for each TaskManager.

host: 192.168.95.113

The number of task slots that each TaskManager offers. Each slot runs one parallel pipeline.

numberOfTaskSlots: 90
memory:
process:

  # The total process memory size for the TaskManager.
  #
  # Note this accounts for all memory usage within the TaskManager process, including JVM metaspace and other overhead.
  # To exclude JVM metaspace and overhead, please, use total Flink memory size instead of 'taskmanager.memory.process.size'.
  # It is not recommended to set both 'taskmanager.memory.process.size' and Flink memory.
  size: 1728m

发布WordCount报错如下:
Caused by: org.apache.flink.util.FlinkExpectedException: TaskExecutor pekko.tcp://flink@192.168.95.113:42306/user/rpc/taskmanager_0 has no more allocated slots for job cfcfd40832244a45fc0b91d2a6d07336.
at org.apache.flink.runtime.taskexecutor.TaskExecutor.closeJobManagerConnectionIfNoAllocatedResources(TaskExecutor.java:2228)
at org.apache.flink.runtime.taskexecutor.TaskExecutor.freeSlotInternal(TaskExecutor.java:2204)
at org.apache.flink.runtime.taskexecutor.TaskExecutor.timeoutSlot(TaskExecutor.java:2242)
at org.apache.flink.runtime.taskexecutor.TaskExecutor.access$3700(TaskExecutor.java:203)
at org.apache.flink.runtime.taskexecutor.TaskExecutor$SlotActionsImpl.lambda$timeoutSlot$1(TaskExecutor.java:2687)
at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.lambda$handleRunAsync$4(PekkoRpcActor.java:460)
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRunAsync(PekkoRpcActor.java:460)
at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRpcMessage(PekkoRpcActor.java:225)
... 22 more

展开
收起
1496033809190915 2024-10-25 16:47:22 378 0
0 条回答
写回答
取消 提交回答

实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。

相关产品

  • 实时计算 Flink版
  • 相关电子书

    更多
    Flink CDC Meetup PPT - 龚中强 立即下载
    Flink CDC Meetup PPT - 王赫 立即下载
    Flink CDC Meetup PPT - 覃立辉 立即下载