In CTP 2.1, data import by Spark Job of data-ingestion-spark.sql was executed, but it caused an error and it can not be imported.
The following message is output to the log on HDFS.
ﾑ�ﾓh揃ﾗｶ9ﾟA@勅甕 �VERSION� �� �APPLICATION_ACL$ MODIFY_APP �root �VIEW_APP �root � �APPLICATION_OWNER� �root( &container_1541841564597_0003_01_000001ﾔﾎ prelaunch.err �0 prelaunch.out �70Setting up env variables Setting up job resources Launching container �stderr �710SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/hadoop-root/nm-local-dir/filecache/10/spark_libs.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] [scallop] Error: Excess arguments provided: 'mssql-master-pool-0.service-master-pool 1433 sa xxxxxxx PolyBase Import_SparkJob hdfs://mssql-master-pool-0.service-master-pool:9000/clickstream_data csv true' �stdout �14102018-11-10 12:04:51 INFO SignalUtils:54 - Registered signal handler for TERM 2018-11-10 12:04:51 INFO SignalUtils:54 - Registered signal handler for HUP 2018-11-10 12:04:51 INFO SignalUtils:54 - Registered signal handler for INT 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing view acls to: root 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing modify acls to: root 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing view acls groups to: 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing modify acls groups to: 2018-11-10 12:04:52 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set() 2018-11-10 12:04:52 INFO ApplicationMaster:54 - Preparing Local resources 2018-11-10 12:04:53 INFO ApplicationMaster:54 - ApplicationAttemptId: appattempt_1541841564597_0003_000001 2018-11-10 12:04:53 INFO ApplicationMaster:54 - Starting the user application in a separate Thread 2018-11-10 12:04:53 INFO ApplicationMaster:54 - Waiting for spark context initialization... 2018-11-10 12:04:53 INFO ApplicationMaster:54 - Final app status: FAILED, exitCode: 13, (reason: Shutdown hook called before final status was reported.) 2018-11-10 12:04:53 INFO ShutdownHookManager:54 - Shutdown hook called � � �VERSION*( &container_1541841564597_0003_01_000001��none��ﾕZﾕZ��data:BCFile.index�noneﾕｦ���data:TFile.index�noneﾕp66�data:TFile.meta�noneﾕj�� ｱ � ﾑ�ﾓh揃ﾗｶ9ﾟA@勅甕
In CTP 2.1, data import by Spark Job of data-ingestion-spark.sql was executed, but it caused an error and it can not be imported.
The following message is output to the log on HDFS.
ﾑ�ﾓh揃ﾗｶ9ﾟA@勅甕 �VERSION� �� �APPLICATION_ACL$ MODIFY_APP �root �VIEW_APP �root � �APPLICATION_OWNER� �root( &container_1541841564597_0003_01_000001ﾔﾎ prelaunch.err �0 prelaunch.out �70Setting up env variables Setting up job resources Launching container �stderr �710SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/hadoop-root/nm-local-dir/filecache/10/spark_libs.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] [scallop] Error: Excess arguments provided: 'mssql-master-pool-0.service-master-pool 1433 sa xxxxxxx PolyBase Import_SparkJob hdfs://mssql-master-pool-0.service-master-pool:9000/clickstream_data csv true' �stdout �14102018-11-10 12:04:51 INFO SignalUtils:54 - Registered signal handler for TERM 2018-11-10 12:04:51 INFO SignalUtils:54 - Registered signal handler for HUP 2018-11-10 12:04:51 INFO SignalUtils:54 - Registered signal handler for INT 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing view acls to: root 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing modify acls to: root 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing view acls groups to: 2018-11-10 12:04:52 INFO SecurityManager:54 - Changing modify acls groups to: 2018-11-10 12:04:52 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set() 2018-11-10 12:04:52 INFO ApplicationMaster:54 - Preparing Local resources 2018-11-10 12:04:53 INFO ApplicationMaster:54 - ApplicationAttemptId: appattempt_1541841564597_0003_000001 2018-11-10 12:04:53 INFO ApplicationMaster:54 - Starting the user application in a separate Thread 2018-11-10 12:04:53 INFO ApplicationMaster:54 - Waiting for spark context initialization... 2018-11-10 12:04:53 INFO ApplicationMaster:54 - Final app status: FAILED, exitCode: 13, (reason: Shutdown hook called before final status was reported.) 2018-11-10 12:04:53 INFO ShutdownHookManager:54 - Shutdown hook called � � �VERSION*( &container_1541841564597_0003_01_000001��none��ﾕZﾕZ��data:BCFile.index�noneﾕｦ���data:TFile.index�noneﾕp66�data:TFile.meta�noneﾕj�� ｱ � ﾑ�ﾓh揃ﾗｶ9ﾟA@勅甕