采用单作业模式提交作业

其实在Flink1.15版本后已逐步弃用,但实际中Flink1.19都还支持单作业模式的提交。命令格式如下:

flink run -c org.example.flink.WordCountStreamSocket FlinkWCdemo-1.0-SNAPSHOT.jar

提交后会报错:

Exception  in  thread  "Thread-5"  java.lang.IllegalStateException:
Trying to access closed classloader. Please check if you store
If the classloaders  directly  or  indirectly  in  static  fields. 
stacktrace suggests that the leak occurs in a third party library
and cannot be fixed immediately, you can disable this check with the
Configuration `classloader.check-leaked-classloader'.
at Org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassL
Oaders

异常处理方案

若出现IllegalStateException提示类加载器泄漏,需修改Flink配置:

  1. 打开配置文件路径:
    cd flink-1.19.2/conf/config.yaml
    

  2. 添加或修改配置项:找到common一栏,加入下面这一行
    classloader.check-leaked-classloader: false
    

    再次提交单作业模式不会再报错了

Logo

DAMO开发者矩阵,由阿里巴巴达摩院和中国互联网协会联合发起,致力于探讨最前沿的技术趋势与应用成果,搭建高质量的交流与分享平台,推动技术创新与产业应用链接,围绕“人工智能与新型计算”构建开放共享的开发者生态。

更多推荐