15/09/19 12:17:10 INFO DAGScheduler: Job 0 finished: take at CsvRelation.scala:174, took 1.900011 s
Error: application failed with exception
java.lang.NoClassDefFoundError: org/apache/spark/sql/types/AtomicType
at com.databricks.spark.csv.CsvRelation.inferSchema(CsvRelation.scala:155)
at com.databricks.spark.csv.CsvRelation.<init>(CsvRelation.scala:70)
at com.databricks.spark.csv.DefaultSource.createRelation(DefaultSource.scala:138)
If using Spark-csv with Spark 1.3.0 , with spark-csv type inference this error is thrown
No comments:
Post a Comment
Please share your views and comments below.
Thank You.