Flink的per-job作业形式提交报错不影响Flink计算
·
采用单作业模式提交作业
其实在Flink1.15版本后已逐步弃用,但实际中Flink1.19都还支持单作业模式的提交。命令格式如下:
flink run -c org.example.flink.WordCountStreamSocket FlinkWCdemo-1.0-SNAPSHOT.jar
提交后会报错:
Exception in thread "Thread-5" java.lang.IllegalStateException:
Trying to access closed classloader. Please check if you store
If the classloaders directly or indirectly in static fields.
stacktrace suggests that the leak occurs in a third party library
and cannot be fixed immediately, you can disable this check with the
Configuration `classloader.check-leaked-classloader'.
at Org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassL
Oaders
异常处理方案
若出现IllegalStateException提示类加载器泄漏,需修改Flink配置:
- 打开配置文件路径:
cd flink-1.19.2/conf/config.yaml - 添加或修改配置项:找到common一栏,加入下面这一行
classloader.check-leaked-classloader: false再次提交单作业模式不会再报错了
DAMO开发者矩阵,由阿里巴巴达摩院和中国互联网协会联合发起,致力于探讨最前沿的技术趋势与应用成果,搭建高质量的交流与分享平台,推动技术创新与产业应用链接,围绕“人工智能与新型计算”构建开放共享的开发者生态。
更多推荐


所有评论(0)