【spark实战：报错】spark序列化报错：Kryo serialization failed: Buffer overflow
发布时间：2026/11/3 1:14:33 锦皓数字建站
文章目录spark序列化报错问题解决spark序列化报错org.apache.spark.SparkException:Kryo serialization failed:Buffer overflow.Available:0,required:61186304.To avoidthis,increase spark.kryoserializer.buffer.max value.at org.apache.spark.serializer.KryoSerializerInstance.serialize(KryoSerializer.scala:300)at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:313)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)问题解决the problem is that kryo does not have enough room in its buffer.You should be adjustingspark.kryoserializer.buffer.maxin your properties file,or use--conf spark.kryoserializer.buffer.max128min your spark-submit command.
锦
锦皓数字建站
深耕本土企业品牌数字化升级，专注原创端正雅致商务官网，从视觉设计到稳定运维全程保驾护航。
